DocumentCode
1648748
Title
Collective prefetching for parallel I/O systems
Author
Chen, Yong ; Roth, Philip C.
Author_Institution
Comput. Sci. & Math. Div., Oak Ridge Nat. Lab., Oak Ridge, TN, USA
fYear
2010
Firstpage
1
Lastpage
5
Abstract
Data prefetching can be beneficial for improving parallel I/O system performance, but the amount of benefit depends on how efficiently and swiftly prefetches can be done. In this study, we propose a new prefetching strategy, called collective prefetching. The idea is to exploit the correlation among I/O accesses of multiple processes of a parallel application and carry out prefetches collectively, instead of the traditional strategy of carrying out prefetches by each process individually. The rationale behind this new collective prefetching strategy is that the concurrent processes of the same parallel application have strong correlation with respect to their I/O requests. We present the idea, initial design and implementation of the new collective prefetching strategy in this study. The preliminary experimental results show that this new collective prefetching strategy holds promise for improving parallel I/O performance.
Keywords
input-output programs; parallel processing; storage management; I/O access; collective prefetching; concurrent process; data prefetching; parallel I/O system; parallel application; Bandwidth; Correlation; File systems; Optimization; Prediction algorithms; Prefetching; Protocols; MPI-IO; collective prefetching; exascale computing; high-performance computing; middleware; parallel I/O; parallel file systems; performance; prefetching; storage;
fLanguage
English
Publisher
ieee
Conference_Titel
Petascale Data Storage Workshop (PDSW), 2010 5th
Conference_Location
New Orleans, LA
ISSN
2157-7242
Print_ISBN
978-1-4244-8913-8
Electronic_ISBN
2157-7242
Type
conf
DOI
10.1109/PDSW.2010.5668089
Filename
5668089
Link To Document