A critical evaluation of spectrum-based fault localization techniques on a large-scale software system

File Description SizeFormat 
stardust.pdfAccepted version708.18 kBAdobe PDFDownload
Title: A critical evaluation of spectrum-based fault localization techniques on a large-scale software system
Author(s): Keller, F
Grunske, L
Heiden, S
Filieri, A
Van Hoorn, A
Lo, D
Item Type: Conference Paper
Abstract: In the past, spectrum-based fault localization (SBFL) techniques have been developed to pinpoint a fault location in a program given a set of failing and successful test executions. Most of the algorithms use similarity coefficients and have only been evaluated on established but small benchmark programs from the Software-artifact Infrastructure Repository (SIR). In this paper, we evaluate the feasibility of applying 33 state-of-the-art SBFL techniques to a large real-world project, namely ASPECTJ. From an initial set of 350 faulty version from the iBugs repository of ASPECTJ we manually classified 88 bugs where SBFL techniques are suitable. Notably, only 11 bugs of these bugs can be found after examining the 1000 most suspicious lines and on average 250 source code files need to be inspected per bug. Based on these results, the study showcases the limitations of current SBFL techniques on a larger program.
Publication Date: 15-Aug-2017
Date of Acceptance: 25-Jul-2017
URI: http://hdl.handle.net/10044/1/52225
DOI: https://dx.doi.org/10.1109/QRS.2017.22
ISBN: 9781538605929
Publisher: IEEE
Start Page: 114
End Page: 125
Journal / Book Title: Proceedings - 2017 IEEE International Conference on Software Quality, Reliability and Security, QRS 2017
Copyright Statement: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Conference Name: 2017 IEEE International Conference on Software Quality, Reliability and Security, QRS 2017
Publication Status: Published
Start Date: 2017-07-25
Finish Date: 2017-07-29
Conference Place: Prague, Czech Republic
Appears in Collections:Faculty of Engineering
Computing



Items in Spiral are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons