The design of a test suite for evaluating a parallelizing translator

The design and effectiveness of a test suite for a parallelizing translator that performs FORTRAN source-to- source transformations and converts FORTRAN DO-loops to parallel loops are described. A test suite for such a translator should evaluate that 1) the transformed program runs correctly; 2) the desired transformations are performed; and 3) transformations that do not improve performance are not performed. This test suite focuses correctness testing on exercising the data dependence analysis algorithm that are used for program transformations. For performance testing, it specifically targets at a list of desired/undesired transformations. This suite has been proven very effective in detecting errors in dependence analysis and flaws in program transformations. Also, the test suite completes in a few hours and reports test results automatically