A scalable high-performance I/O system

Author

Henderson, Mark ; Nickless, Bill ; Stevens, Rick

Author_Institution

Div. of Math. & Comput. Sci., Argonne Nat. Lab., IL, USA

fYear

1994

fDate

23-25 May 1994

Firstpage

79

Lastpage

86

Abstract

A significant weakness of many existing parallel supercomputers is their lack of high-performance parallel I/O. This weakness has prevented, in many cases, the full exploitation of the true potential of MPP systems. As part of a joint project with IBM, we have designed a parallel I/O system for an IBM SP system that can provide sustained I/O rates of greater than 160 MB/s from collections of compute nodes to archival disk and peak transfer rates that should exceed 400 MB/s from compute nodes to I/O servers. This testbed system is being used for a number of projects, first it will provide a high-performance experimental I/O system for traditional computational science applications, second it will be used as an I/O software and development environment for new parallel I/O algorithms and operating systems support, and third it will be used as the foundation for a number of new projects designed to develop enabling technology for the National Information Infrastructure. This report describes the system under development at Argonne National Laboratory, provides some preliminary performance results, and outlines future experiments and directions

Keywords

input-output programs; operating systems (computers); parallel algorithms; parallel machines; parallel processing; 160 Mbit/s; 400 Mbit/s; IBM; IBM SP system; National Information Infrastructure; archival disk rates; computational science applications; compute nodes; development environment; high performance input output system; operating systems; parallel I/O algorithms; parallel input output algorithm; parallel supercomputers; peak transfer rates; scalable high-performance I/O system; Algorithm design and analysis; Application software; Computer applications; Concurrent computing; Laboratories; Operating systems; Software algorithms; Software testing; Supercomputers; System testing;

fLanguage

English

Publisher

ieee

Conference_Titel

Scalable High-Performance Computing Conference, 1994., Proceedings of the

Conference_Location

Knoxville, TN

Print_ISBN

0-8186-5680-8

Type

conf

DOI

10.1109/SHPCC.1994.296630

Filename

296630