Title :
Small Files Problem in Parallel File System
Author :
Li, Xiuqiao ; Dong, Bin ; Xiao, Limin ; Ruan, Li ; Ding, Yi
Author_Institution :
Sch. of Comput. Sci. & Eng., Beihang Univ., Beijing, China
Abstract :
Parallel file systems suffer performance degradation of small files generated by many workloads. We provide the systematic analysis of the small files problem from aspects of both parallel file system architecture and workload characteristics. Based on the analysis, we discuss the deficiencies of current optimizations and propose several open questions and possible research directions to address the problem.
Keywords :
file organisation; parallel architectures; parallel file system architecture; small files problem; workload characteristics; Computer architecture; File systems; Optimization; Parallel processing; Performance evaluation; Prefetching; Servers; access pattern; optimization; parallel file system; small files problem;
Conference_Titel :
Network Computing and Information Security (NCIS), 2011 International Conference on
Conference_Location :
Guilin
Print_ISBN :
978-1-61284-347-6
DOI :
10.1109/NCIS.2011.143
