Publication Type
Conference Proceeding Article
Version
submittedVersion
Publication Date
9-2010
Abstract
In statistics and data mining communities, there have been many measures proposed to gauge the strength of association between two variables of interest, such as odds ratio, confidence, Yule-Y, Yule-Q, Kappa, and gini index. These association measures have been used in various domains, for example, to evaluate whether a particular medical practice is associated positively to a cure of a disease or whether a particular marketing strategy is associated positively to an increase in revenue, etc. This paper models the problem of locating faults as association between the execution or non-execution of particular program elements with failures. There have been special measures, termed as suspiciousness measures, proposed for the task. Two state-of-the-art measures are Tarantula and Ochiai, which are different from many other statistical measures. To the best of our knowledge, there is no study that comprehensively investigates the effectiveness of various association measures in localizing faults. This paper fills in the gap by evaluating 20 wellknown association measures and compares their effectiveness in fault localization tasks with Tarantula and Ochiai. Evaluation on the Siemens programs show that a number of association measures perform statistically comparable as Tarantula and Ochiai.
Keywords
Association measures, Fault location, Debugging, Data mining, Statistical analysis, Variables of interest
Discipline
Software Engineering
Research Areas
Software Systems
Publication
Proceedings of the IEEE International Conference on Software Maintenance (ICSM)
First Page
1
Last Page
10
ISBN
9781424486281
Identifier
10.1109/ICSM.2010.5609542
Publisher
IEEE
City or Country
Timisoara, Romania
Citation
Lucia, David Lo, Jiang Lingxiao, Aditya Budi. 2010. "Comprehensive Evaluation of Association Measures for Fault Localization." In Proceedings of IEEE International Conference on Software Maintenance (ICSM), September 12-18, Timisoara, Romania.. New York: IEEE. doi: 10.1109/ICSM.2010.5609542
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
http://dx.doi.org/10.1109/ICSM.2010.5609542
Comments
To cite the data package, please use the following citation:
Lucia, Lo, D., Lingxiao, J., & Budi, A. (2010). Data from: Comprehensive evaluation of association measures for fault localization. InK Repository at Singapore Management University. http://ink.library.smu.edu.sg/sis_research/1330