DocumentCode
1918654
Title
Poster: Distributed Metadata Management for Exascale Parallel File System
Author
Yamamoto, Keiji ; Hori, Atsushi ; Ishikawa, Yutaka
fYear
2012
fDate
10-16 Nov. 2012
Firstpage
1438
Lastpage
1438
Abstract
In today´s supercomputer, most file systems provide scalable I/O bandwidth. But these systems cannot concurrent creation of millions to billions of files in a single directory. Toward exascale-era, we propose scalable metadata management method by using many metadata servers. Directory entry and inode are distributed by using consistent hashing. Directory entry and inode are stored as same MDS as possible. In many case, two request of lookup dentry and inode are merged into one request. In evaluation, our file system throughput is more than 490,000 file creates per second on 64 metadata servers and 2048 clients. Concurrent file creation time of 40 million is 42 second in a single directory.
fLanguage
English
Publisher
ieee
Conference_Titel
High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:
Conference_Location
Salt Lake City, UT
Print_ISBN
978-1-4673-6218-4
Type
conf
DOI
10.1109/SC.Companion.2012.242
Filename
6496025
Link To Document