Title :
A method for analysing the performance of certain testing techniques for concurrent systems
Author :
Kellomäki, Timo ; Valmari, Antti
Author_Institution :
Inst. of Software Syst., Tampere Univ. of Technol., Finland
Abstract :
In this paper we develop a method for analysing and comparing the performance of different testing techniques for concurrent systems, and use it to give some evidence that the so-called "exploration testing" finds errors faster than traditional testing based on test cases. We model the system under test as a state space with a weight and cost assigned to each transition, and find the probability and expected cost of reaching terminal states. From this information, the probabilities and expected costs of finding errors using each method can be computed. A drawback of our method is that it is not feasible for arbitrarily large systems, but, in return, it gives results much quicker and with much higher precision than possible by running actual tests.
Keywords :
concurrency control; program testing; reachability analysis; software performance evaluation; state-space methods; computation cost; concurrent systems; exploration testing; probability; software testing; state space; terminal state reachability; Automatic testing; Computer errors; Costs; Electronic mail; Performance analysis; Software systems; Software testing; State-space methods; System testing; Timing;
Conference_Titel :
Application of Concurrency to System Design, 2005. ACSD 2005. Fifth International Conference on
Print_ISBN :
0-7695-2363-3
DOI :
10.1109/ACSD.2005.1