Publication Type
Journal Article
Version
acceptedVersion
Publication Date
8-2022
Abstract
Studies have estimated that, in industrial settings, developers spend between 30 and 90 percent of their time fixing bugs. As such, tools that assist in identifying the location of bugs provide value by reducing debugging costs. One such tool is BugLocator. This study initially aimed to determine if developers working on the Adobe Analytics product could use BugLocator. The initial results show that BugLocator achieves a similar accuracy on five of seven Adobe Analytics repositories and on open-source projects. However, these results do not meet the minimum applicability requirement deemed necessary by Adobe Analytics developers prior to possible adoption. Thus, we consequently examine how BugLocator can achieve the targeted accuracy with two extensions: (1) adding more data corpora, and (2) massively composing individual rankers consisting of augmented BugLocator instances trained on various combinations of corpora and parameter configurations with a Random Forest model. We refer to our final extension as Legion. On average, applying Legion to Adobe Analytics repositories results in at least one buggy file ranked in the top-ten recommendations 76.8 percent of the time for customer-reported bugs across all 7 repositories. This represents a substantial improvement over BugLocator of 36.4 percent, and satisfies the minimum applicability requirement. Additionally, our extensions boost Mean Average Precision by 107.7 percent, Mean Reciprocal Rank by 86.1 percent, Top 1 by 143.4 percent and Top 5 by 58.1 percent.
Keywords
Bug localization, information retrieval, bug reports, data augmentation, ranker composition, industrial study
Discipline
Software Engineering
Research Areas
Software and Cyber-Physical Systems
Publication
IEEE Transactions on Software Engineering
Volume
48
Issue
8
First Page
3010
Last Page
3024
ISSN
0098-5589
Identifier
10.1109/TSE.2021.3075215
Publisher
Institute of Electrical and Electronics Engineers
Citation
JARMAN, Darryl; BERRY, Jeffrey; SMITH, Riley; THUNG, Ferdian; and LO, David.
Legion: Massively composing rankers for improved bug localization at Adobe. (2022). IEEE Transactions on Software Engineering. 48, (8), 3010-3024.
Available at: https://ink.library.smu.edu.sg/sis_research/7636
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1109/TSE.2021.3075215