AHPIOS: An MPI-Based Ad Hoc Parallel I/O System

Author

Isailå, Florin ; Blas, Javier Garcia ; Carretero, Jesus ; Liao, Wei-keng ; Choudhary, Alok

Author_Institution

Univ. Carlos III of Madrid, Madrid, Spain

fYear

2008

fDate

8-10 Dec. 2008

Firstpage

253

Lastpage

260

Abstract

This paper presents the design and implementation of a portable ad-hoc parallel I/O system (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPI-IO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.

Keywords

application program interfaces; message passing; parallel processing; shared memory systems; MPI-IO library; data servers; distributed storage resources; parallel file system; portable ad-hoc parallel I/O system; shared-disk architecture; Concurrent computing; Cost function; File systems; Libraries; Resource virtualization; Stability; Supercomputers; cluster computing; parallel I/O; parallel file systems; virtualization;

fLanguage

English

Publisher

ieee

Conference_Titel

Parallel and Distributed Systems, 2008. ICPADS '08. 14th IEEE International Conference on

Conference_Location

Melbourne, VIC

ISSN

1521-9097

Print_ISBN

978-0-7695-3434-3

Type

conf

DOI

10.1109/ICPADS.2008.50

Filename

4724327