DocumentCode
659425
Title
Kylin: An efficient and scalable graph data processing system
Author
Li-Yung Ho ; Tsung-Han Li ; Jan-Jan Wu ; Pangfeng Liu
Author_Institution
Dept. of Comput. Sci. & Inf. Eng., Nat. Taiwan Univ., Taipei, Taiwan
fYear
2013
fDate
6-9 Oct. 2013
Firstpage
193
Lastpage
198
Abstract
We introduce Kylin, an efficient and scalable graph data processing system. Kylin is based on bulk synchronization processing(BSP) model to process graph data. Although there have been some BSP-based graph processing systems, Kylin is different from these systems in two-fold. First, Kylin cooperates with HBase to achieve scalable data manipulation. Second, We propose three techniques to optimize the performance of Kylin. The proposed techniques are pull messaging, lazy vertex loading and vertex-weighted partitioning. We demonstrate Kylin outperforms other BSP-based systems, i.e. Hama and Giraph, in the experiments.
Keywords
data handling; graph theory; parallel algorithms; BSP-based graph processing systems; Giraph; HBase; Hama; Kylin; bulk synchronization processing model; data manipulation; graph data processing system system; lazy vertex loading; pull messaging; vertex-weighted partitioning; Approximation algorithms; Bipartite graph; Computational modeling; Data processing; Databases; Loading; Synchronization; dynamic loading; graph data partition; graph data processing; load balancing; pull messaging;
fLanguage
English
Publisher
ieee
Conference_Titel
Big Data, 2013 IEEE International Conference on
Conference_Location
Silicon Valley, CA
Type
conf
DOI
10.1109/BigData.2013.6691574
Filename
6691574
Link To Document