A distributed abnormal packet generation engine based on MapReduce

With the maturity of Internet and rapid development of the Mobile Internet, the network protocols drafted by IETF, 3GPP, 3GPP2 and other standard organizations grow massively, and at the same time attacks against the network protocols are also increasing rapidly. The Robustness test for the network protocols is becoming increasingly important, since the protocols and applications will be absolutely safe if the protocols have been tested according to the requirements of the Robustness Test. But Robustness Test is different from Conformance Test, Interoperability Test and Performance Test in its requirement of a huge number of test cases, and the number of test cases is more than 2^320 for a packet with 40-Byte protocol header, thus, it´s too difficult to generate all the test cases for the serial algorithm. In this paper a parallel algorithm based on MapReduce is proposed, where an original input packet is divided into different fields and the Map function processes on each single field and the Reduce function reassembles the processed fields to a new completed packet. Finally, experiment results show the parallel algorithm is far better than the serial algorithm when generating large data set. In addition, the scalability of the cluster is also verified.