• DocumentCode
    560194
  • Title

    A scalable eigensolver for large scale-free graphs using 2D graph partitioning

  • Author

    Yoo, Andy ; Baker, Allison H. ; Pearce, Roger ; Henson, Van Emden

  • Author_Institution
    Center for Appl. Sci. Comput., Lawrence Livermore Nat. Lab., Lawrence, CA, USA
  • fYear
    2011
  • fDate
    12-18 Nov. 2011
  • Firstpage
    1
  • Lastpage
    11
  • Abstract
    Eigensolvers are important tools for analyzing and mining useful information from scale-free graphs. Such graphs are used in many applications and can be extremely large. Unfortunately, existing parallel eigensolvers do not scale well for these graphs due to the high communication overhead in the parallel matrix-vector multiplication (MatVec). We develop a MatVec algorithm based on 2D edge partitioning that significantly reduces the communication costs and embed it into a popular eigensolver library. We demonstrate that the enhanced eigensolver can attain two orders of magnitude performance improvement compared to the original on a state-of-art massively parallel machine. We illustrate the performance of the embedded MatVec by computing eigenvalues of a scale-free graph with 300 million vertices and 5 billion edges, the largest scale-free graph analyzed by any in-memory parallel eigensolver, to the best of our knowledge.
  • Keywords
    data analysis; data mining; eigenvalues and eigenfunctions; graph theory; matrix multiplication; vectors; 2D edge partitioning; 2D graph partitioning; MatVec algorithm; information analysis; information mining; large scale-free graphs; parallel machine; parallel matrix-vector multiplication; scalable eigensolver; Generators; Libraries; Partitioning algorithms; Program processors; Scalability; Sparse matrices; Vectors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    High Performance Computing, Networking, Storage and Analysis (SC), 2011 International Conference for
  • Conference_Location
    Seatle, WA
  • Electronic_ISBN
    978-1-4503-0771-0
  • Type

    conf

  • Filename
    6114462