Metadata only
Date
2023-07-26Type
- Conference Paper
ETH Bibliography
yes
Altmetrics
Abstract
We report on the organization and results of the second edition of the tool competition from the International Workshop on Natural Language-based Software Engineering (NLBSE'23). As in the prior edition, we organized the competition on automated issue report classification, with a larger dataset. This year, we featured an extra competition on au-tomated code comment classification. In this tool competition edition, five teams submitted multiple classification models to automatically classify issue reports and code comments. The submitted models were fine-tuned and evaluated on a benchmark dataset of 1.4 million issue reports or 6.7 thousand code comments, respectively. The goal of the competition was to improve the classification performance of the baseline models that we provided. This paper reports details of the competition, including the rules, the teams and contestant models, and the ranking of models based on their average classification performance across issue report and code comment types. Show more
Publication status
publishedExternal links
Book title
2023 IEE/ACM International Workshop on Natural Language-Based Software Engineering (NLBSE)Pages / Article No.
Publisher
IEEEEvent
Subject
Tool-Competition; Labeling; Benchmark; Issue Reports; Code CommentsMore
Show all metadata
ETH Bibliography
yes
Altmetrics