Title :
A Real-Time Distributed Query Solution Based on the OPC
Author :
Zhi Yang ; Kezhen Ju ; Chunping Zhang ; Mu Hu ; Feng Lin
Author_Institution :
State Grid Electr. Power Sci. Res. Inst., Nanjing, China
Abstract :
The distributed query is one of the research focus in the Big Data. Nowadays, many companies and institutions provide technology and products to realize function or improve efficiency in the all kinds of database. In the scene of electricity, using these techniques, the real-time requirement (<;10s) cannot be met. This paper provides a real-time distributed query solution with Objectification Parallel Computing (OPC) to solve the above challenges. The data split from Big Data, is distributed stored in memory of cluster in the OPC. In the solution, making use of the thought of divide and rule and tree merging, there are two stages. The first stage is local data query. The intermediate query result can be obtained. The second stage is multistage summarizing. The final result can be returned to user. The solution has been applied to the power production management system (PMS) of State Grid of China. The results show that solution is efficiently reliable and meets real-time.
Keywords :
Big Data; parallel processing; query processing; Big Data; OPC; PMS; data query; objectification parallel computing; power production management system; real-time distributed query solution; Big data; Computers; Distributed databases; Merging; Parallel processing; Real-time systems; Time complexity; Big Data; Binary Location; Distributed Query; Objectification Parallel Computing;
Conference_Titel :
Cloud Computing and Big Data (CCBD), 2014 International Conference on
DOI :
10.1109/CCBD.2014.18