Software test data generation using program instrumentation

This paper presents the design of the software system, ADTEST, for generating test data for programs developed in Ada. The key feature of this system is that the problem of test data generation is treated entirely as a dynamic numerical optimisation problem and, as a, consequence, this method does not suffer from difficulties commonly found in symbolic execution systems, such as those associated with input-variable-dependent loops, array references, and module calls. Instead, program instrumentation is used to solve a set of path constraints without explicitly knowing their form. The system supports not only the generation of integer and real data types, but also non-numeric data types such as characters and enumerated types. The system has been tested on large Ada programs (>60000 lines of code) and found to reduce the effort required to test programs as well as provide an increase in test coverage