High Performance Wide Area Data Transfers over High Performance Networks

Authors:
Philip Dickens;William Gropp;Paul R. Woodward
Affiliations:
-;-;-
Venue:
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Year:
2002

Citing 3
Cited 3

Automatic TCP buffer tuning

Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication
The failure of TCP in high-performance computational grids

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
PSockets: the case for application-level network striping for data intensive applications using high speed wide area networks

Proceedings of the 2000 ACM/IEEE conference on Supercomputing

Scalable Bulk Data Transfer in Wide Area Networks

International Journal of High Performance Computing Applications
A lightweight, high performance communication protocol for grid computing

Cluster Computing
Towards a bayesian statistical model for the classification of the causes of data loss

HPCC'05 Proceedings of the First international conference on High Performance Computing and Communications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces a new user-level communication protocol designed to provide high-performance data transfers across high-bandwidth, high-delay, networks. The protocol incorporates the most important enhancements defined by the networking community to improve the performance to TCP for this environment, and also defines enhancements unique to this protocol. In terms of the so-called "Large Window" extensions to TCP, this protocol implements a communication window that is essentially infinite, and provides a selective acknowledgement window that spans the entire data transfer. In terms of user-level extensions to TCP, it implements a user-defined acknowledgement frequency, a user-defined "batch sending" window, and a simple framework within which the user can define the algorithm that determines the next data packet to be sent out across all eligible packets. We present experimental results demonstrating data throughput on the order of 85% - 92% of the maximum available bandwidth across both short haul and long haul high-performance networks.