DocumentCode
560194
Title
A scalable eigensolver for large scale-free graphs using 2D graph partitioning
Author
Yoo, Andy ; Baker, Allison H. ; Pearce, Roger ; Henson, Van Emden
Author_Institution
Center for Appl. Sci. Comput., Lawrence Livermore Nat. Lab., Lawrence, CA, USA
fYear
2011
fDate
12-18 Nov. 2011
Firstpage
1
Lastpage
11
Abstract
Eigensolvers are important tools for analyzing and mining useful information from scale-free graphs. Such graphs are used in many applications and can be extremely large. Unfortunately, existing parallel eigensolvers do not scale well for these graphs due to the high communication overhead in the parallel matrix-vector multiplication (MatVec). We develop a MatVec algorithm based on 2D edge partitioning that significantly reduces the communication costs and embed it into a popular eigensolver library. We demonstrate that the enhanced eigensolver can attain two orders of magnitude performance improvement compared to the original on a state-of-art massively parallel machine. We illustrate the performance of the embedded MatVec by computing eigenvalues of a scale-free graph with 300 million vertices and 5 billion edges, the largest scale-free graph analyzed by any in-memory parallel eigensolver, to the best of our knowledge.
Keywords
data analysis; data mining; eigenvalues and eigenfunctions; graph theory; matrix multiplication; vectors; 2D edge partitioning; 2D graph partitioning; MatVec algorithm; information analysis; information mining; large scale-free graphs; parallel machine; parallel matrix-vector multiplication; scalable eigensolver; Generators; Libraries; Partitioning algorithms; Program processors; Scalability; Sparse matrices; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
High Performance Computing, Networking, Storage and Analysis (SC), 2011 International Conference for
Conference_Location
Seatle, WA
Electronic_ISBN
978-1-4503-0771-0
Type
conf
Filename
6114462
Link To Document