Title :
How Well Do Test Case Prioritization Techniques Support Statistical Fault Localization
Author :
Jiang, Bo ; Zhang, Zhenyu ; Tse, T.H. ; Chen, T.Y.
Author_Institution :
Univ. of Hong Kong, Hong Kong, China
Abstract :
In continuous integration, a tight integration of test case prioritization techniques and fault-localization techniques may both expose failures faster and locate faults more effectively. Statistical fault-localization techniques use the execution information collected during testing to locate faults. Executing a small fraction of a prioritized test suite reduces the cost of testing, and yet the subsequent fault localization may suffer. This paper presents the first empirical study to examine the impact of test case prioritization on the effectiveness of fault localization. Among many interesting empirical results, we find that coverage-based and random techniques can be more effective than distribution-based techniques in supporting statistical fault localization.
Keywords :
cost reduction; program compilers; program debugging; program testing; random processes; software cost estimation; software fault tolerance; statistical distributions; code compilation; continuous integration; coverage-based technique; debugging technique; distribution-based technique; empirical study; prioritized test suite; random technique; software process integration; statistical fault localization technique; test case prioritization technique; testing cost reduction; Application software; Australia Council; Computer applications; Computer science; Costs; Feedback; Resumes; Software debugging; Software testing; Continuous integration; fault localization; software process integration; test case prioritization;
Conference_Titel :
Computer Software and Applications Conference, 2009. COMPSAC '09. 33rd Annual IEEE International
Conference_Location :
Seattle, WA
Print_ISBN :
978-0-7695-3726-9
DOI :
10.1109/COMPSAC.2009.23