Achievements and Challenges of Metamorphic Testing

A fundamental problem software testing faces is the so called "test oracle problem", which restricts the development of software testing techniques significantly. Metamorphic Testing (MT) can provide a way to determine the correctness of testing outputs with metamorphic relations between a series of outputs that correspond to a series of inputs, which is regarded as one of the most effective techniques to alleviate oracle problem. This paper reviews previous works on MT and proposes the major challenges of MT, with the goal of supporting future practices and researches in this area.