Title :
Efficient Zero-Copy Noncontiguous I/O for Globus on InfiniBand
Author :
Yu, Weikuan ; Tian, Yuan ; Vetter, Jeffrey S.
Author_Institution :
Dept. of Comput. Sci., Auburn Univ., Auburn, AL, USA
Abstract :
Noncontiguous I/O access is one of the main access patterns in parallel and distributed applications. An I/O architecture EXIO enables Globus, a popular run-time environment for distributed computing, on RDMA networks such as InfiniBand. In this paper, we investigate the benefits of InfiniBand zero-copy RDMA to noncontiguous I/O on Globus. Our experimental results demonstrate that, by enabling zero-copy RDMA on InfiniBand, EXIO significantly improves the performance of Globus noncontiguous I/O. Compared to the packing and unpacking, zero-copy RDMA improve the bandwidth by up to 2.7 times. Compared to both IPoIB and 10GigE, it increases the bandwidth by more than three times. While achieving efficient noncontiguous I/O, RDMA-based noncontiguous I/O on InfiniBand also leads to dramatical reduction of CPU utilization on Globus clients and servers.
Keywords :
client-server systems; grid computing; input-output programs; parallel processing; protocols; Globus noncontiguous I/O; InfiniBand zero-copy RDMA network; data movement protocols; distributed computing; parallel computing; zero-copy noncontiguous I/O access; Bandwidth; Data communication; Driver circuits; IP networks; Protocols; Receivers; Semantics; RDMA; XIO;
Conference_Titel :
Parallel Processing Workshops (ICPPW), 2010 39th International Conference on
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4244-7918-4
Electronic_ISBN :
1530-2016
DOI :
10.1109/ICPPW.2010.56