Hadoop-Based System Design for Website Intrusion Detection and Analysis

It is very important and practical to make data analysis for intrusion detection based on large scale data. For the current system problem in simulation and off-line analysis, a set of system is proposed as intrusion detection and analysis for truly website. The system is integrated with two subsystems of intrusion detection and large data analysis. Through network construction and software design, the system achieved functions of intrusion detection, data storage, data cleaning and data mining. It can make large data analysis under Hadoop system and Mahout Framework. Firstly, the well-known KDD data is studied to get the relationship of training entries and testing accuracy. The 10% of the training samples presents enough data in classification algorithm. Under the monitoring system, experimental results show that the system can quickly establish the random forest model. It can achieve good detection effects.