• DocumentCode
    183094
  • Title

    Implementation of a parallel graph partition algorithm to speed up BSP computing

  • Author

    Shengmei Luo ; Lixia Liu ; Hongxu Wang ; Bin Wu ; Yang Liu

  • Author_Institution
    Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
  • fYear
    2014
  • fDate
    19-21 Aug. 2014
  • Firstpage
    740
  • Lastpage
    744
  • Abstract
    The processing and mining information in large scale graph data have proven to be challenging. The bulk synchronous parallel (BSP) computing model is suitable for this task. In this paper, we implement the multi-level step-wise partitioning (MSP) algorithm in BSP programming model, and replace the original graph partition method. The results on both experimental data and real world data proved this improvement achieved better data locality, reduced communication between work nodes, and it made a better performance than the original method.
  • Keywords
    data mining; graph theory; parallel processing; BSP computing; BSP programming model; MSP algorithm; bulk synchronous parallel computing model; communication reduction; data locality; information mining; information processing; large-scale graph data; multilevel step-wise partitioning algorithm; parallel graph partition algorithm implementation; work nodes; Algorithm design and analysis; Communities; Computational modeling; Computers; Engines; Parallel processing; Partitioning algorithms; BSP; HAMA; MapReduce; complex network; graph partition;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Fuzzy Systems and Knowledge Discovery (FSKD), 2014 11th International Conference on
  • Conference_Location
    Xiamen
  • Print_ISBN
    978-1-4799-5147-5
  • Type

    conf

  • DOI
    10.1109/FSKD.2014.6980928
  • Filename
    6980928