The Application of Spark in the Power Grid Intelligent Decision Analysis Platform

Intelligent Decision Analysis Platform is an advanced application of decision and analysis based on the construction of "State Grid 186" in China. The platform is committed to achieve the goal of all kinds of business managements and developments. It mainly focuses on providing scientific decisions by data mining and predicting after status data being analyzed. With the auxiliary support of the platform, power enterprises are capable of making better strategies and increasing revenue eventually. According to the characteristics of smart grid monitoring and the requirements of management efficiently as well as the demand of reliable storage of massive grid data, this paper puts forward the decision and analysis platform based on the parallel processing framework which is called Spark and the fault-tolerant abstraction for in-memory cluster computing embedded in Spark as it is known as Resilient Distributed Datasets (RDDs). This paper gives detailed analysis of the feasibility and the advantages of the new method, as well as some unsolved problems.