• DocumentCode
    659425
  • Title

    Kylin: An efficient and scalable graph data processing system

  • Author

    Li-Yung Ho ; Tsung-Han Li ; Jan-Jan Wu ; Pangfeng Liu

  • Author_Institution
    Dept. of Comput. Sci. & Inf. Eng., Nat. Taiwan Univ., Taipei, Taiwan
  • fYear
    2013
  • fDate
    6-9 Oct. 2013
  • Firstpage
    193
  • Lastpage
    198
  • Abstract
    We introduce Kylin, an efficient and scalable graph data processing system. Kylin is based on bulk synchronization processing(BSP) model to process graph data. Although there have been some BSP-based graph processing systems, Kylin is different from these systems in two-fold. First, Kylin cooperates with HBase to achieve scalable data manipulation. Second, We propose three techniques to optimize the performance of Kylin. The proposed techniques are pull messaging, lazy vertex loading and vertex-weighted partitioning. We demonstrate Kylin outperforms other BSP-based systems, i.e. Hama and Giraph, in the experiments.
  • Keywords
    data handling; graph theory; parallel algorithms; BSP-based graph processing systems; Giraph; HBase; Hama; Kylin; bulk synchronization processing model; data manipulation; graph data processing system system; lazy vertex loading; pull messaging; vertex-weighted partitioning; Approximation algorithms; Bipartite graph; Computational modeling; Data processing; Databases; Loading; Synchronization; dynamic loading; graph data partition; graph data processing; load balancing; pull messaging;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Big Data, 2013 IEEE International Conference on
  • Conference_Location
    Silicon Valley, CA
  • Type

    conf

  • DOI
    10.1109/BigData.2013.6691574
  • Filename
    6691574