DocumentCode :
2858574
Title :
High performance storage system scalability: architecture, implementation and experience
Author :
Watson, Richard W.
Author_Institution :
Lawrence Livermore Nat. Lab., Berkeley, CA, USA
fYear :
2005
fDate :
11-14 April 2005
Firstpage :
145
Lastpage :
159
Abstract :
The high performance storage system (HPSS) provides scalable hierarchical storage management (HSM), archive, and file system services. Its design, implementation and current dominant use are focused on HSM and archive services. It is also a general-purpose, global, shared, parallel file system, potentially useful in other application domains. When HPSS design and implementation began over a decade ago, scientific computing power and storage capabilities at a site, such as a DOE national laboratory, was measured in a few 10 s of gigaops, data archived in HSMs in a few 10 s of terabytes at most, data throughput rates to an HSM in a few megabytes/s, and daily throughput with the HSM in a few gigabytes/day. At that time, the DOE national laboratories and IBM HPSS design team recognized that we were headed for a data storage explosion driven by computing power rising to teraops/petaops requiring data stored in HSMs to rise to petabytes and beyond, data transfer rates with the HSM to rise to gigabytes/s and higher, and daily throughput with a HSM in 10 s of terabytes/day. This paper discusses HPSS architectural, implementation and deployment experiences that contributed to its success in meeting the above orders of magnitude scaling targets. We also discuss areas that need additional attention as we continue significant scaling into the future.
Keywords :
distributed shared memory systems; memory architecture; storage management; HPSS architecture; HPSS design; archive service; data storage; file system service; hierarchical storage management; high performance storage system; parallel file system; scientific computing; Explosions; File systems; Laboratories; Memory; Power measurement; Power system management; Scalability; Scientific computing; Throughput; US Department of Energy;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Mass Storage Systems and Technologies, 2005. Proceedings. 22nd IEEE / 13th NASA Goddard Conference on
Print_ISBN :
0-7695-2318-8
Type :
conf
DOI :
10.1109/MSST.2005.17
Filename :
1410731
Link To Document :
بازگشت