Title :
New quality estimations in random testing
Author :
Mankefors, S. ; Torkar, R. ; Boklund, A.
Author_Institution :
Dept. of Informatics & Math., Univ. of Trollhattan/Uddevalla, Trollhattan, Sweden
Abstract :
By reformulating the issue of random testing into an equivalent problem we are able to introduce a new kind of quality estimations based on Monte Carlo integration and the central limit theorem. This method also provides a limited but working "success theory" in the case of no detected failures. In an empirical evaluation using hundreds of billions of simulated tests we furthermore find a very good match between the quality estimations presented in this article and the true failure frequencies. Both simple modulus defects as well as seeded defects in two extensively employed numerical routines were subject to investigation in the empirical work.
Keywords :
Monte Carlo methods; program testing; random processes; software quality; Monte Carlo integration; central limit theorem; failure detection; modulus defects; random testing; software evaluation; software quality estimation; software testing; Aerospace electronics; Frequency estimation; Informatics; Mathematics; Monte Carlo methods; NASA; Software testing; Space shuttles; Statistical analysis; System testing;
Conference_Titel :
Software Reliability Engineering, 2003. ISSRE 2003. 14th International Symposium on
Print_ISBN :
0-7695-2007-3
DOI :
10.1109/ISSRE.2003.1251067