Title :
Input Domain Reduction through Irrelevant Variable Removal and Its Effect on Local, Global, and Hybrid Search-Based Structural Test Data Generation
Author :
McMinn, Phil ; Harman, Mark ; Lakhotia, Kiran ; Hassoun, Youssef ; Wegener, Joachim
Author_Institution :
Univ. of Sheffield, Sheffield, UK
Abstract :
Search-Based Test Data Generation reformulates testing goals as fitness functions so that test input generation can be automated by some chosen search-based optimization algorithm. The optimization algorithm searches the space of potential inputs, seeking those that are “fit for purpose,” guided by the fitness function. The search space of potential inputs can be very large, even for very small systems under test. Its size is, of course, a key determining factor affecting the performance of any search-based approach. However, despite the large volume of work on Search-Based Software Testing, the literature contains little that concerns the performance impact of search space reduction. This paper proposes a static dependence analysis derived from program slicing that can be used to support search space reduction. The paper presents both a theoretical and empirical analysis of the application of this approach to open source and industrial production code. The results provide evidence to support the claim that input domain reduction has a significant effect on the performance of local, global, and hybrid search, while a purely random search is unaffected.
Keywords :
automatic test pattern generation; optimisation; program compilers; program slicing; program testing; public domain software; search problems; fitness functions; hybrid search-based structural test data generation; industrial production code; input domain reduction; irrelevant variable removal; key determining factor; open source approach; program slicing; search space reduction; search-based optimization algorithm; search-based software testing; static dependence analysis; test input generation; Algorithm design and analysis; Input variables; Optimization; Search problems; Software algorithms; Software testing; Search-based software testing; automated test data generation; evolutionary testing; input domain reduction.;
Journal_Title :
Software Engineering, IEEE Transactions on
DOI :
10.1109/TSE.2011.18