• DocumentCode
    1648748
  • Title

    Collective prefetching for parallel I/O systems

  • Author

    Chen, Yong ; Roth, Philip C.

  • Author_Institution
    Comput. Sci. & Math. Div., Oak Ridge Nat. Lab., Oak Ridge, TN, USA
  • fYear
    2010
  • Firstpage
    1
  • Lastpage
    5
  • Abstract
    Data prefetching can be beneficial for improving parallel I/O system performance, but the amount of benefit depends on how efficiently and swiftly prefetches can be done. In this study, we propose a new prefetching strategy, called collective prefetching. The idea is to exploit the correlation among I/O accesses of multiple processes of a parallel application and carry out prefetches collectively, instead of the traditional strategy of carrying out prefetches by each process individually. The rationale behind this new collective prefetching strategy is that the concurrent processes of the same parallel application have strong correlation with respect to their I/O requests. We present the idea, initial design and implementation of the new collective prefetching strategy in this study. The preliminary experimental results show that this new collective prefetching strategy holds promise for improving parallel I/O performance.
  • Keywords
    input-output programs; parallel processing; storage management; I/O access; collective prefetching; concurrent process; data prefetching; parallel I/O system; parallel application; Bandwidth; Correlation; File systems; Optimization; Prediction algorithms; Prefetching; Protocols; MPI-IO; collective prefetching; exascale computing; high-performance computing; middleware; parallel I/O; parallel file systems; performance; prefetching; storage;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Petascale Data Storage Workshop (PDSW), 2010 5th
  • Conference_Location
    New Orleans, LA
  • ISSN
    2157-7242
  • Print_ISBN
    978-1-4244-8913-8
  • Electronic_ISBN
    2157-7242
  • Type

    conf

  • DOI
    10.1109/PDSW.2010.5668089
  • Filename
    5668089