• DocumentCode
    3043609
  • Title

    Scalable high-level caching for parallel I/O

  • Author

    Coloma, Kenin ; Choudhary, Alok ; Liao, Wei-keng ; Ward, Lee ; Russell, Eric ; Pundit, Neil

  • Author_Institution
    Center for Parallel & Distributed Comput., Northwestern Univ., Evanston, IL, USA
  • fYear
    2004
  • fDate
    26-30 April 2004
  • Firstpage
    96
  • Abstract
    Summary form only given. In order for I/O systems to achieve high performance in a parallel environment, they must either sacrifice client-side file caching, or keep caching and deal with complex coherency issues. The most common technique for dealing with cache coherency in multiclient file caching environments uses file locks to bypass the client-side cache. Aside from effectively disabling cache usage, file locking is sometimes unavailable on larger systems. The high-level abstraction layer of MPI allows us to tackle cache coherency with additional information and coordination without using file locks. By approaching the cache coherency issue further up, the underlying I/O accesses can be modified in such a way as to ensure access to coherent data while satisfying the user´s I/O request. We can effectively exploit the benefits of a file system´s client-side cache while minimizing its management costs.
  • Keywords
    cache storage; client-server systems; message passing; parallel processing; I/O system; MPl; abstraction; client-side file caching; file locking; keep caching; parallel I/O; scalable high-level caching; Bandwidth; Concurrent computing; Costs; Delay; Distributed computing; Environmental management; File systems; High performance computing; Laboratories; Throughput;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Parallel and Distributed Processing Symposium, 2004. Proceedings. 18th International
  • Print_ISBN
    0-7695-2132-0
  • Type

    conf

  • DOI
    10.1109/IPDPS.2004.1303043
  • Filename
    1303043