Title :
Optimization algorithm of massive data query based on JOIN
Author :
Zheng Jiajia ; Sun Jiasong
Author_Institution :
Dept. of Electron. Eng., Tsinghua Univ., Beijing, China
Abstract :
The paper uses parallel computation of grid and data grid as theoretical basis. The isomerism of each node and difference of communication rate under grid environment, and massive data query makes query operations of database difficult. For the new structural characteristic, the paper proposes a parallel JOIN algorithm based on massive data, it fully uses parallelism and reduces transmission volume to shorten response time. The paper includes implementation and optimization of JOIN algorithm, fault-tolerant mechanism, RDMM, partition and transmission of massive data.
Keywords :
fault tolerant computing; grid computing; optimisation; parallel algorithms; query processing; RDMM; data grid; database; fault-tolerant mechanism; massive data query; optimization algorithm; parallel JOIN algorithm; parallel computation; Algorithm design and analysis; Clustering algorithms; Indexes; Joints; Parallel processing; Time factors; grid computation; massive data; optimization algorithm; parallel computing;
Conference_Titel :
Software Engineering and Service Science (ICSESS), 2014 5th IEEE International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4799-3278-8
DOI :
10.1109/ICSESS.2014.6933718