DocumentCode :
1648748
Title :
Collective prefetching for parallel I/O systems
Author :
Chen, Yong ; Roth, Philip C.
Author_Institution :
Comput. Sci. & Math. Div., Oak Ridge Nat. Lab., Oak Ridge, TN, USA
fYear :
2010
Firstpage :
1
Lastpage :
5
Abstract :
Data prefetching can be beneficial for improving parallel I/O system performance, but the amount of benefit depends on how efficiently and swiftly prefetches can be done. In this study, we propose a new prefetching strategy, called collective prefetching. The idea is to exploit the correlation among I/O accesses of multiple processes of a parallel application and carry out prefetches collectively, instead of the traditional strategy of carrying out prefetches by each process individually. The rationale behind this new collective prefetching strategy is that the concurrent processes of the same parallel application have strong correlation with respect to their I/O requests. We present the idea, initial design and implementation of the new collective prefetching strategy in this study. The preliminary experimental results show that this new collective prefetching strategy holds promise for improving parallel I/O performance.
Keywords :
input-output programs; parallel processing; storage management; I/O access; collective prefetching; concurrent process; data prefetching; parallel I/O system; parallel application; Bandwidth; Correlation; File systems; Optimization; Prediction algorithms; Prefetching; Protocols; MPI-IO; collective prefetching; exascale computing; high-performance computing; middleware; parallel I/O; parallel file systems; performance; prefetching; storage;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Petascale Data Storage Workshop (PDSW), 2010 5th
Conference_Location :
New Orleans, LA
ISSN :
2157-7242
Print_ISBN :
978-1-4244-8913-8
Electronic_ISBN :
2157-7242
Type :
conf
DOI :
10.1109/PDSW.2010.5668089
Filename :
5668089
Link To Document :
بازگشت