Lightweight messages: true zero-copy communication for commodity gigabit ethernet

Authors:
Hai Jin;Minghu Zhang;Pengliu Tan
Affiliations:
Cluster and Grid Computing Lab, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China;Cluster and Grid Computing Lab, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China;Cluster and Grid Computing Lab, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China
Venue:
EUC'06 Proceedings of the 2006 international conference on Emerging Directions in Embedded and Ubiquitous Computing
Year:
2006

Citing 12
Cited 0

Optimistic implementation of bulk data transfer protocols

SIGMETRICS '89 Proceedings of the 1989 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Fbufs: a high-bandwidth cross-domain transfer facility

SOSP '93 Proceedings of the fourteenth ACM symposium on Operating systems principles
U-Net: a user-level network interface for parallel and distributed computing

SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
IO-lite: a unified I/O buffering and caching system

OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
EMP: zero-copy OS-bypass NIC-driven gigabit ethernet message passing

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
The Virtual Interface Architecture

IEEE Micro
PM: An Operating System Coordinated High Performance Communication Library

HPCN Europe '97 Proceedings of the International Conference and Exhibition on High-Performance Computing and Networking
Exploiting Gigabit Ethernet Capacity for Cluster Applications

LCN '02 Proceedings of the 27th Annual IEEE Conference on Local Computer Networks
High Performance User Level Sockets over Gigabit Ethernet

CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
Speculative Defragmentation - A Technique to Improve the Communication Software Efficiency for Gigabit Ethernet

HPDC '00 Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing
The Lighweight Protocol CLIC on Gigabit Ethernet

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Zero-copy TCP in Solaris

ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Gigabit Ethernet has become the main cluster interconnection for its low price and well backward compatibility. But the communication performance through Gigabit Ethernet is quite disappointing due to its performance discre- pancies between the hardware and the communication software. To achieve over two-third physical bandwidth of a gigabit network interface, zero-copy protocol architecture is absolutely necessary. Unfortunately, it is impossible to realize true zero-copy communication over non re-programmable commodity Gigabit Ethernet adapters because the DMA engines cannot separate the protocol headers from the payload data directly. This paper introduces LM (Lightweight Messages), a true zero-copy communication mechanism which combines the application level fragmentation scheme with the driver level defragmentation scheme, for existing non-programmable Gigabit Ethernet adapters. Finally, experimental results show that LM can provide better performance than other lightweight communication approaches over commodity Gigabit Ethernet.