DocumentCode
183094
Title
Implementation of a parallel graph partition algorithm to speed up BSP computing
Author
Shengmei Luo ; Lixia Liu ; Hongxu Wang ; Bin Wu ; Yang Liu
Author_Institution
Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
fYear
2014
fDate
19-21 Aug. 2014
Firstpage
740
Lastpage
744
Abstract
The processing and mining information in large scale graph data have proven to be challenging. The bulk synchronous parallel (BSP) computing model is suitable for this task. In this paper, we implement the multi-level step-wise partitioning (MSP) algorithm in BSP programming model, and replace the original graph partition method. The results on both experimental data and real world data proved this improvement achieved better data locality, reduced communication between work nodes, and it made a better performance than the original method.
Keywords
data mining; graph theory; parallel processing; BSP computing; BSP programming model; MSP algorithm; bulk synchronous parallel computing model; communication reduction; data locality; information mining; information processing; large-scale graph data; multilevel step-wise partitioning algorithm; parallel graph partition algorithm implementation; work nodes; Algorithm design and analysis; Communities; Computational modeling; Computers; Engines; Parallel processing; Partitioning algorithms; BSP; HAMA; MapReduce; complex network; graph partition;
fLanguage
English
Publisher
ieee
Conference_Titel
Fuzzy Systems and Knowledge Discovery (FSKD), 2014 11th International Conference on
Conference_Location
Xiamen
Print_ISBN
978-1-4799-5147-5
Type
conf
DOI
10.1109/FSKD.2014.6980928
Filename
6980928
Link To Document