Publication Type

Conference Proceeding Article

Version

publishedVersion

Publication Date

3-2013

Abstract

To collect software bugs found by users, development teams often setup bug trackers using systems such as Bugzilla. Developers would then fix some of the bugs and commit corresponding code changes into version control systems such as svn or git. Unfortunately, the links between bug reports and code changes are missing for many software projects as the bug tracking and version control systems are often maintained separately. Yet, linking bug reports to fix commits is important as it could shed light into the nature of bug fixing processes and expose patterns in software management. Bug linking solutions, such as ReLink, have been proposed. The demonstration of their effectiveness however faces a number of issues, including a reliability issue with their ground truth datasets as well as the extent of their measurements. We propose in this study a benchmark for evaluating bug linking solutions. This benchmark includes a dataset of about 12,000 bug links from 10 programs. These true links between bug reports and their fixes have been provided during bug fixing processes. We designed a number of research questions, to assess both quantitatively and qualitatively the effectiveness of a bug linking tool. Finally, we apply this benchmark on ReLink to report the strengths and limitations of this bug linking tool.

Keywords

computer software, software bugs, bug tracking, bug linking

Discipline

Software Engineering

Research Areas

Software and Cyber-Physical Systems

Publication

CSMR 2013: Proceedings of the 2013 17th European Conference on Software Maintenance and Reengineering: 5-8 March 2013, Genova, Italy

First Page

89

Last Page

98

ISBN

9781467358330

Identifier

10.1109/CSMR.2013.19

Publisher

IEEE Computer Society

City or Country

Los Alamitos, CA

Copyright Owner and License

Authors

Additional URL

http://doi.org/10.1109/CSMR.2013.19

Download

Share

COinS