Usefulness Evaluation of Simulation in Server System Testing

This paper evaluates the usefulness of different simulators developed in server system testing for a mobile application during 5 years, with the purpose of identifying the advantages and weaknesses of each simulation method in the given setup. The study found that simulation was used on almost every interface to external systems, and two factors that affected the usefulness of simulators over long term were the functionality supported and the applicable usage scenarios. Large-scale simulation did not keep yielding high returns. In the mobile application of server/client architecture, emulating external servers raised the testing capability, and emulating mobile clients led to higher efficiency. The findings in this study can be used as references for software teams to plan simulation in QA activities properly for faster QA cycles, deeper understanding of the system, more stable test results and lower resource costs.