Title: Benchmarking classification models for software defect prediction: A proposed framework and novel findings
Authors: Lessmann, S. ×
Baesens, Bart
Mues, Christophe
Pietsch, S. #
Issue Date: Jul-2008
Series Title: IEEE transactions on software engineering vol:34 issue:4 pages:485-496
Abstract: Software defect prediction strives to improve software quality and testing efficiency by constructing predictive classification models from code attributes to enable a timely identification of fault-prone modules. Several classification models have been evaluated for this task. However, due to inconsistent findings regarding the superiority of one classifier over another and the usefulness of metric-based classification in general, more research is needed to improve convergence across studies and further advance confidence in experimental results. We consider three potential sources for bias: comparing classifiers over one or a small number of proprietary data sets, relying on accuracy indicators that are conceptually inappropriate for software defect prediction and cross-study comparisons, and, finally, limited use of statistical testing procedures to secure empirical findings. To remedy these problems, a framework for comparative software defect prediction experiments is proposed and applied in a large-scale empirical comparison of 22 classifiers over 10 public domain data sets from the NASA Metrics Data repository. Overall, an appealing degree of predictive accuracy is observed, which supports the view that metric-based classification is useful. However, our results indicate that the importance of the particular classification algorithm may be less than previously assumed since no significant performance differences could be detected among the top 17 classifiers.
ISSN: 0098-5589
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Administrative and Support Services, Faculty of Economics and Business, Leuven - miscellaneous
Research Center for Management Informatics (LIRIS), Leuven
× corresponding author
# (joint) last author

Files in This Item:

There are no files associated with this item.

Request a copy


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science