• DocumentCode
    1918654
  • Title

    Poster: Distributed Metadata Management for Exascale Parallel File System

  • Author

    Yamamoto, Keiji ; Hori, Atsushi ; Ishikawa, Yutaka

  • fYear
    2012
  • fDate
    10-16 Nov. 2012
  • Firstpage
    1438
  • Lastpage
    1438
  • Abstract
    In today´s supercomputer, most file systems provide scalable I/O bandwidth. But these systems cannot concurrent creation of millions to billions of files in a single directory. Toward exascale-era, we propose scalable metadata management method by using many metadata servers. Directory entry and inode are distributed by using consistent hashing. Directory entry and inode are stored as same MDS as possible. In many case, two request of lookup dentry and inode are merged into one request. In evaluation, our file system throughput is more than 490,000 file creates per second on 64 metadata servers and 2048 clients. Concurrent file creation time of 40 million is 42 second in a single directory.
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:
  • Conference_Location
    Salt Lake City, UT
  • Print_ISBN
    978-1-4673-6218-4
  • Type

    conf

  • DOI
    10.1109/SC.Companion.2012.242
  • Filename
    6496025