Design and implementation a high performance communication library based on commodity Ethernet NICs

A high performance communication library independent of hardware called HPCL/Ethernet is implemented based on commodity Ethernet NICs on the Linux. HPCL/Ethernet supports commodity Ethernet NICs by using the network device interface on the Linux kernel. Reliable message delivery is guaranteed in the software layer. Channel is adopted for simplifying buffer management and fixed-buffer policy is adopted for avoiding message copy. Both interrupt reaping technology and the policy of message processing in link layer are also used to optimize communication. The experimental results show that the HPCL/Ethernet is characteristic of low latency with short payload message and high bandwidth with long payload message. It provides 1.18E+08 bytes/s of bandwidth for 1196 bytes message which is 94.4% of hardware-level bandwidth.