Title :
Multiple profile evaluation using a single test suite in random testing
Author :
Mankefors-Christiernin, S. ; Boklund, A.
Author_Institution :
Dept. of Technol., Math. & Comput. Sci., Univ. of Trollhattan, Sweden
Abstract :
Using an integral formulation of random testing for regular continuous input, we present an approximate solution that enables highly accurate estimations of the results for arbitrary operational profiles, using strategically chosen input in a single test suite. The current approach, building on the Lagrange interpolation and Gaussian integration theorems, thus solves the longstanding issue of the necessity of unique test suites for fundamentally different operational profiles in random testing. Empirical comparisons are furthermore performed for a total of 27 profiles on five seeded faults in a numerical routine and a straightforward modulus fault. Using a high enough expansion in the approximation, the resulting failure frequencies and variances became statistically identical with the "ordinary" evaluations in all cases. It thus becomes possible to eliminate any extra test cases and still keep full accuracy when changing between operational profiles.
Keywords :
Gaussian processes; approximation theory; interpolation; program testing; software reliability; Gaussian integration theorem; Lagrange interpolation; approximation theory; integral formulation; operational profile evaluation; random testing; Automatic testing; Computer science; Frequency; Interpolation; Lagrangian functions; Mathematics; Performance evaluation; Software performance; Software quality; Software testing;
Conference_Titel :
Software Reliability Engineering, 2004. ISSRE 2004. 15th International Symposium on
Print_ISBN :
0-7695-2215-7
DOI :
10.1109/ISSRE.2004.24