Title :
Distributed algorithms for k-truss decomposition
Author :
Pei-Ling Chen ; Chung-Kuang Chou ; Ming-Syan Chen
Author_Institution :
Dept. of Electr. Eng., Nat. Taiwan Univ., Taipei, Taiwan
Abstract :
k-truss, a type of cohesive subgraphs of a network, is an important measure for a social network graph. However, with the emergence of large online social networks, the running time of the traditional batch algorithms for k-truss decomposition is usually prohibitively long on such a graph with billions of edges and millions of vertices. Moreover, the size of a graph becomes too large to load into the main memory of a single machine. Currently, cloud computing has become an imperative way to process the big data. Thus, our aim is to design a scalable algorithm of k-truss decomposition in the scenario of cloud computing. In this paper, we first improve the existing distributed k-truss decomposition in the MapReduce framework. We then propose a theoretical basis for k-truss and use it to design an algorithm based on graph-parallel abstractions. Our experiment results show that our method in the graph-parallel abstraction significantly outperforms the methods based on MapReduce in terms of running time and disk usage.
Keywords :
Big Data; cloud computing; distributed algorithms; graph theory; network theory (graphs); social networking (online); MapReduce framework; big data; cloud computing; distributed algorithms; distributed k-truss decomposition; k-truss Decomposition; social network graph; Algorithm design and analysis; Cloud computing; Computational modeling; Distributed algorithms; Google; Partitioning algorithms; Social network services; Large graph processing; Parallel processing; k-truss decomposition;
Conference_Titel :
Big Data (Big Data), 2014 IEEE International Conference on
Conference_Location :
Washington, DC
DOI :
10.1109/BigData.2014.7004264