Title :
Optimal testing resource allocation, and sensitivity analysis in software development
Author :
Huang, Chin-Yu ; Lyu, Michael R.
Author_Institution :
Dept. of Comput. Sci., Nat. Tsing Hua Univ., Hsinchu, Taiwan
Abstract :
We consider two kinds of software testing-resource allocation problems. The first problem is to minimize the number of remaining faults given a fixed amount of testing-effort, and a reliability objective. The second problem is to minimize the amount of testing-effort given the number of remaining faults, and a reliability objective. We have proposed several strategies for module testing to help software project managers solve these problems, and make the best decisions. We provide several systematic solutions based on a nonhomogeneous Poisson process model, allowing systematic allocation of a specified amount of testing-resource expenditures for each software module under some constraints. We describe several numerical examples on the optimal testing-resource allocation problems to show applications & impacts of the proposed strategies during module testing. Experimental results indicate the advantages of the approaches we proposed in guiding software engineers & project managers toward best testing resource allocation in practice. Finally, an extensive sensitivity analysis is presented to investigate the effects of various principal parameters on the optimization problem of testing-resource allocation. The results can help us know which parameters have the most significant influence, and the changes of optimal testing-effort expenditures affected by the variations of fault detection rate & expected initial faults.
Keywords :
decision making; optimisation; program testing; project management; resource allocation; sensitivity analysis; software fault tolerance; stochastic processes; decision making; nonhomogeneous Poisson process; numerical analysis; optimization; sensitivity analysis; software development; software engineer; software fault; software project manager; software reliability; software testing-resource allocation; Fault detection; Power system reliability; Programming; Project management; Resource management; Sensitivity analysis; Software reliability; Software testing; System testing; Tellurium; Non-homogeneous Poisson processes; sensitivity analysis; software reliability; testing resource allocation;
Journal_Title :
Reliability, IEEE Transactions on
DOI :
10.1109/TR.2005.858099