PM/InfiniBand-FJ: a high performance communication facility using InfiniBand for large scale PC clusters

Author

Sumimoto, Shinji ; Naruse, Akira ; Kumon, Kouichi ; Hosoe, Kouji ; Shimizu, Toshiyuki

Author_Institution

Fujitsu Labs. Ltd., Kawasaki, Japan

fYear

2004

fDate

20-22 July 2004

Firstpage

104

Lastpage

113

Abstract

This work describes a design of high performance communication facility called the PM/InfiniBand-FJ using InfiniBand interconnect for large scale PC clusters. The PM/InfiniBand-FJ has developed to realize higher application performance than commercial supercomputers and comparable availability to them. Since the specification of InfiniBand interconnect is designed for communication among servers and I/Os, there are some issues to use InfiniBand for high performance computation on over 1000 node PC clusters. Therefore, the PM/InfiniBand-FJ solves the issues by expanding the original specification of InfiniBand. We have implemented the PM/InfiniBand-FJ on SCore cluster system software, and evaluated the communication and application performance. The performance results show that a 913.2 MB/s of bandwidth and 15.6 μs round trip time have been achieved on Xeon 2.8GHz PC with ServerWorks GC LE chipset. The result of NAS parallel benchmark shows that the 128 node result of IS Class B on PM/InfiniBand-FJ is 1.52 times faster than that of PM/MyrinetXP using Fujitsu PR1MERGY RX200 PC cluster (Xeon 3.06GHz).

Keywords

multiprocessor interconnection networks; network operating systems; software performance evaluation; workstation clusters; Fujitsu PR1MERGY RX200 PC cluster; InfiniBand interconnect; NAS parallel benchmark; PM/InfiniBand-FJ; PM/MyrinetXP; SCore cluster system software; ServerWorks GC LE chipset; Xeon; communication facility; large scale PC clusters; Application software; Automobiles; Availability; Bandwidth; Computational modeling; High performance computing; Laboratories; Large-scale systems; Supercomputers; System software;

fLanguage

English

Publisher

ieee

Conference_Titel

High Performance Computing and Grid in Asia Pacific Region, 2004. Proceedings. Seventh International Conference on

Print_ISBN

0-7695-2138-X

Type

conf

DOI

10.1109/HPCASIA.2004.1324023

Filename

1324023