Title :
AHPIOS: An MPI-Based Ad Hoc Parallel I/O System
Author :
Isailå, Florin ; Blas, Javier Garcia ; Carretero, Jesus ; Liao, Wei-keng ; Choudhary, Alok
Author_Institution :
Univ. Carlos III of Madrid, Madrid, Spain
Abstract :
This paper presents the design and implementation of a portable ad-hoc parallel I/O system (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPI-IO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.
Keywords :
application program interfaces; message passing; parallel processing; shared memory systems; MPI-IO library; data servers; distributed storage resources; parallel file system; portable ad-hoc parallel I/O system; shared-disk architecture; Concurrent computing; Cost function; File systems; Libraries; Resource virtualization; Stability; Supercomputers; cluster computing; parallel I/O; parallel file systems; virtualization;
Conference_Titel :
Parallel and Distributed Systems, 2008. ICPADS '08. 14th IEEE International Conference on
Conference_Location :
Melbourne, VIC
Print_ISBN :
978-0-7695-3434-3
DOI :
10.1109/ICPADS.2008.50
