MetTest: A Test Automation Framework for Development of a Point-To-Multipoint Radio

Continuous and timely testing is an indispensable activity for agile software development, which requires assignment of persistent and dedicated resources throughout the whole life cycle of a project. Testing becomes even more complicated when the system under test is a distributed and embedded real-time system. In this study, we present MetTest, an industrial test automation framework designed and deployed for development of a point-to-multipoint Ethernet based radio having various modes of operation, each with an associated performance goal. MetTest pursues an automated and a scheduled sequence of actions consisting of building executable from a code repository, running unit and full system performance tests on hardware, measuring and verifying necessary performance metrics and e- mailing a summary to the attention of software developers. MetTest also stores test results for long term analysis and tracking of software performance through a web application. Some long- term statistics and test results acquired from the framework are also presented to demonstrate the usefulness of the framework.