Title :
Kylin: An efficient and scalable graph data processing system
Author :
Li-Yung Ho ; Tsung-Han Li ; Jan-Jan Wu ; Pangfeng Liu
Author_Institution :
Dept. of Comput. Sci. & Inf. Eng., Nat. Taiwan Univ., Taipei, Taiwan
Abstract :
We introduce Kylin, an efficient and scalable graph data processing system. Kylin is based on bulk synchronization processing(BSP) model to process graph data. Although there have been some BSP-based graph processing systems, Kylin is different from these systems in two-fold. First, Kylin cooperates with HBase to achieve scalable data manipulation. Second, We propose three techniques to optimize the performance of Kylin. The proposed techniques are pull messaging, lazy vertex loading and vertex-weighted partitioning. We demonstrate Kylin outperforms other BSP-based systems, i.e. Hama and Giraph, in the experiments.
Keywords :
data handling; graph theory; parallel algorithms; BSP-based graph processing systems; Giraph; HBase; Hama; Kylin; bulk synchronization processing model; data manipulation; graph data processing system system; lazy vertex loading; pull messaging; vertex-weighted partitioning; Approximation algorithms; Bipartite graph; Computational modeling; Data processing; Databases; Loading; Synchronization; dynamic loading; graph data partition; graph data processing; load balancing; pull messaging;
Conference_Titel :
Big Data, 2013 IEEE International Conference on
Conference_Location :
Silicon Valley, CA
DOI :
10.1109/BigData.2013.6691574