Design and implementation of zero-copy data path for efficient file transmission

Authors:
Dong-Jae Kang;Young-Ho Kim;Gyu-Il Cha;Sung-In Jung;Myung-Joon Kim;Hae-Young Bae
Affiliations:
Dept. of Computer Science and Information Engineering, In-Ha University, Incheon, Korea;Digital Home Division, ETRI, Internet Server Group, Daejeon, Korea;Digital Home Division, ETRI, Internet Server Group, Daejeon, Korea;Digital Home Division, ETRI, Internet Server Group, Daejeon, Korea;Digital Home Division, ETRI, Internet Server Group, Daejeon, Korea;Dept. of Computer Science and Information Engineering, In-Ha University, Incheon, Korea
Venue:
HPCC'06 Proceedings of the Second international conference on High Performance Computing and Communications
Year:
2006

Citing 13
Cited 0

IO-Lite: a unified I/O buffering and caching system

ACM Transactions on Computer Systems (TOCS)
EMP: zero-copy OS-bypass NIC-driven gigabit ethernet message passing

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Zero copy I: user-mode perspective

Linux Journal
Efficient Utilization of Memory Mapped NICs onto Clusters using Pipelined Schedules

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Pin-down Cache: A Virtual Memory Management Technique for Zero-copy Communication

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Improving the I/O performance of intermediate multimedia storage nodes

Multimedia Systems
Evaluating the performance of user-space and kernel-space web servers

CASCON '04 Proceedings of the 2004 conference of the Centre for Advanced Studies on Collaborative research
LyraNET: A Zero-Copy TCP/IP Protocol Stack for Embedded Operating Systems

RTCSA '05 Proceedings of the 11th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications
Zero Copy Sockets Direct Protocol over InfiniBand — Preliminary Implementation and Performance Analysis

HOTI '05 Proceedings of the 13th Symposium on High Performance Interconnects
Active Zero-copy: A performance study of non-deterministic messaging

ISPDC '05 Proceedings of the The 4th International Symposium on Parallel and Distributed Computing
The UVM virtual memory system

ATEC '99 Proceedings of the annual conference on USENIX Annual Technical Conference
Design and implementation of an improved zero-copy file transfer mechanism

PDCAT'04 Proceedings of the 5th international conference on Parallel and Distributed Computing: applications and Technologies
TCP/IP offload engine module supporting binary compatibility for standard socket interfaces

GCC'05 Proceedings of the 4th international conference on Grid and Cooperative Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Huge requests for file transmission by concurrent users cause excessive memory copy operations and system calls between kernel and user space, which are very expensive and require many CPU cycles for processing. And it has been a bottleneck that limits the number of serviceable requests and prevents CPU resources from being allocated to other processes. In this paper, we suppose the zero-copy data path for efficient file transmission to solve the upper described problems. To do that, we used existing system call interface, sendfile, for file transmission from one device to another and used the same buffer page to transmit a file. The supposed zero-copy data path reduces CPU cost per transaction by eliminating CPU copies between kernel and user space and by avoiding unnecessary system calls in user space. The improved CPU efficiency means that a larger number of requests can be serviced with the same CPU configuration.