DocumentCode :
3585107
Title :
PSA: A Performance and Space-Aware Data Layout Scheme for Hybrid Parallel File Systems
Author :
Shuibing He ; Yan Liu ; Xian-He Sun
Author_Institution :
Sch. of Comput., Wuhan Univ., Wuhan, China
fYear :
2014
Firstpage :
41
Lastpage :
48
Abstract :
The underlying storage of hybrid parallel file systems (PFS) is composed of both SSD-based file servers (SServer) and HDD-based file servers (HServer). Unlike a traditional HServer, an SServer consistently provides improved storage performance but lacks storage space. However, most current data layout schemes do not consider the differences in performance and space between heterogeneous servers, and may significantly degrade the performance of the hybrid PFSs. In this paper, we propose PSA, a novel data layout scheme, which maximizes the hybrid PFSs performance by applying adaptive varied-size file stripes. PSA dispatches data on heterogeneous file servers not only based on storage performance but also storage space. We have implemented PSA within OrangeFS, a popular parallel file system in the HPC domain. Our extensive experiments using a representative benchmark show that PSA provides superior I/O throughput than the default and performance-aware file data layout schemes.
Keywords :
disc drives; file servers; flash memories; hard discs; input-output programs; parallel processing; storage management; HDD-based file servers; HPC domain; HServer; OrangeFS parallel file system; PSA data layout scheme; SSD-based file servers; SServer; adaptive varied-size file stripes; heterogeneous file servers; hybrid PFS; hybrid parallel file systems; performance and space-aware data layout scheme; superior I/O throughput; Benchmark testing; Layout; Media; Optimization; Performance evaluation; Servers; Throughput; Parallel I/O System; Parallel File system; Data Layout; Solid State Drive;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Data Intensive Scalable Computing Systems (DISCS), 2014 International Workshop on
Type :
conf
DOI :
10.1109/DISCS.2014.10
Filename :
7079025
Link To Document :
بازگشت