On the accuracy of spectrum-based fault localization
R Abreu, P Zoeteweij… - Testing: Academic and …, 2007 - ieeexplore.ieee.org
R Abreu, P Zoeteweij, AJC Van Gemund
Testing: Academic and industrial conference practice and research …, 2007•ieeexplore.ieee.orgSpectrum-based fault localization shortens the test-diagnose-repair cycle by reducing the
debugging effort. As a light-weight automated diagnosis technique it can easily be
integrated with existing testing schemes. However, as no model of the system is taken into
account, its diagnostic accuracy is inherently limited. Using the Siemens Set benchmark, we
investigate this diagnostic accuracy as a function of several parameters (such as quality and
quantity of the program spectra collected during the execution of the system), some of which …
debugging effort. As a light-weight automated diagnosis technique it can easily be
integrated with existing testing schemes. However, as no model of the system is taken into
account, its diagnostic accuracy is inherently limited. Using the Siemens Set benchmark, we
investigate this diagnostic accuracy as a function of several parameters (such as quality and
quantity of the program spectra collected during the execution of the system), some of which …
Spectrum-based fault localization shortens the test- diagnose-repair cycle by reducing the debugging effort. As a light-weight automated diagnosis technique it can easily be integrated with existing testing schemes. However, as no model of the system is taken into account, its diagnostic accuracy is inherently limited. Using the Siemens Set benchmark, we investigate this diagnostic accuracy as a function of several parameters (such as quality and quantity of the program spectra collected during the execution of the system), some of which directly relate to test design. Our results indicate that the superior performance of a particular similarity coefficient, used to analyze the program spectra, is largely independent of test design. Furthermore, near- optimal diagnostic accuracy (exonerating about 80% of the blocks of code on average) is already obtained for low-quality error observations and limited numbers of test cases. The influence of the number of test cases is of primary importance for continuous (embedded) processing applications, where only limited observation horizons can be maintained.
ieeexplore.ieee.org