Toward supporting data parallel programming on clusters of symmetric multiprocessors

Author

Chiang, Chia-Lien ; Wu, Jan-Jan ; Lin, Nai-Wei

Author_Institution

Dept. of Comput. Sci., Nat. Chung Cheng Univ., Chia-Yi, Taiwan

fYear

1998

fDate

14-16 Dec 1998

Firstpage

607

Lastpage

614

Abstract

The paper reports the design of a runtime library for data-parallel programming on clusters of symmetric multiprocessors (SMP clusters). Our design algorithms exploit a hybrid methodology which maps directly to the underlying hierarchical memory system in SMP clusters, by combining two styles of programming methodologies-threads (shared memory programming) within a SMP node and message passing between SMP nodes. This hybrid approach has been used in the implementation of a library for collective communications. The prototype library is implemented based on standard interfaces for threads (pthread) and message passing (MPI). Experimental results on a cluster of Sun UltraSparc-II workstations are reported

Keywords

message passing; multi-threading; multiprocessing systems; shared memory systems; MPI; SMP clusters; SMP node; Sun UltraSparc-II workstations; collective communication; data parallel programming; design algorithms; hierarchical memory system; hybrid approach; hybrid methodology; message passing; programming methodologies; prototype library; pthread; runtime library; shared memory programming; standard interfaces; symmetric multiprocessor clusters; Application software; Clustering algorithms; Computer science; Concurrent computing; Hardware; High performance computing; Message passing; Parallel programming; Sun; Workstations;

fLanguage

English

Publisher

ieee

Conference_Titel

Parallel and Distributed Systems, 1998. Proceedings. 1998 International Conference on

Conference_Location

Tainan

ISSN

1521-9097

Print_ISBN

0-8186-8603-0

Type

conf

DOI

10.1109/ICPADS.1998.741143

Filename

741143