Title :
Scalable high-level caching for parallel I/O
Author :
Coloma, Kenin ; Choudhary, Alok ; Liao, Wei-keng ; Ward, Lee ; Russell, Eric ; Pundit, Neil
Author_Institution :
Center for Parallel & Distributed Comput., Northwestern Univ., Evanston, IL, USA
Abstract :
Summary form only given. In order for I/O systems to achieve high performance in a parallel environment, they must either sacrifice client-side file caching, or keep caching and deal with complex coherency issues. The most common technique for dealing with cache coherency in multiclient file caching environments uses file locks to bypass the client-side cache. Aside from effectively disabling cache usage, file locking is sometimes unavailable on larger systems. The high-level abstraction layer of MPI allows us to tackle cache coherency with additional information and coordination without using file locks. By approaching the cache coherency issue further up, the underlying I/O accesses can be modified in such a way as to ensure access to coherent data while satisfying the user´s I/O request. We can effectively exploit the benefits of a file system´s client-side cache while minimizing its management costs.
Keywords :
cache storage; client-server systems; message passing; parallel processing; I/O system; MPl; abstraction; client-side file caching; file locking; keep caching; parallel I/O; scalable high-level caching; Bandwidth; Concurrent computing; Costs; Delay; Distributed computing; Environmental management; File systems; High performance computing; Laboratories; Throughput;
Conference_Titel :
Parallel and Distributed Processing Symposium, 2004. Proceedings. 18th International
Print_ISBN :
0-7695-2132-0
DOI :
10.1109/IPDPS.2004.1303043