Performance of a GridFTP overlay network

Authors:
Phil Rizk;Cameron Kiddle;Rob Simmonds;Brian Unger
Affiliations:
Department of Computer Science, University of Calgary, Calgary, Alberta, Canada;Department of Computer Science, University of Calgary, Calgary, Alberta, Canada;Department of Computer Science, University of Calgary, Calgary, Alberta, Canada;Department of Computer Science, University of Calgary, Calgary, Alberta, Canada
Venue:
Future Generation Computer Systems
Year:
2008

Citing 29
Cited 2

Observations on the dynamics of a congestion control algorithm: the effects of two-way traffic

SIGCOMM '91 Proceedings of the conference on Communications architecture & protocols
Dynamics of congestion control and avoidance of two-way traffic in an OSI testbed

ACM SIGCOMM Computer Communication Review
The macroscopic behavior of the TCP congestion avoidance algorithm

ACM SIGCOMM Computer Communication Review
Improving reliable transport and handoff performance in cellular wireless networks

Wireless Networks
Improving TCP throughput over two-way asymmetric links: analysis and solutions

SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Modeling TCP throughput: a simple model and its empirical validation

Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication
Modeling TCP Reno performance: a simple model and its empirical validation

IEEE/ACM Transactions on Networking (TON)
PSockets: the case for application-level network striping for data intensive applications using high speed wide area networks

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Resilient overlay networks

SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Implementing a performance forecasting system for metacomputing: the Network Weather Service

SC '97 Proceedings of the 1997 ACM/IEEE conference on Supercomputing
End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput

Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Predicting the Performance of Wide Area Data Transfers

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Reliable File Transfer in Grid Environments

LCN '02 Proceedings of the 27th Annual IEEE Conference on Local Computer Networks
Predicting Sporadic Grid Data Transfers

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
A Parallel Discrete Event IP Network Emulator

MASCOTS '00 Proceedings of the 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems
Two-Way TCP Traffic over ATM: Effects and Analysis

INFOCOM '97 Proceedings of the INFOCOM '97. Sixteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Driving the Information Revolution
The Logistical Session Layer

HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
I-TCP: indirect TCP for mobile hosts

ICDCS '95 Proceedings of the 15th International Conference on Distributed Computing Systems
Improving Throughput for Grid Applications with Network Logistics

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
The Globus eXtensible Input/Output System (XIO): A Protocol Independent IO System for the Grid

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 4 - Volume 05
Exploring practical limitations of TCP over transatlantic networks

Future Generation Computer Systems - Special issue: High-speed networks and services for data-intensive grids: The DataTAG project
On the predictability of large transfer TCP throughput

Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communications
The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Improving GridFTP Performance with Split TCP Connections

E-SCIENCE '05 Proceedings of the First International Conference on e-Science and Grid Computing
A GridFTP Overlay Network Service

GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Globus toolkit version 4: software for service-oriented systems

NPC'05 Proceedings of the 2005 IFIP international conference on Network and Parallel Computing
Using proxies to enhance TCP performance over hybrid fiber coaxial networks

Computer Communications
Transport protocols for Internet-compatible satellite networks

IEEE Journal on Selected Areas in Communications
On-board satellite "split TCP" proxy

IEEE Journal on Selected Areas in Communications

A study on performance of dynamic file replication algorithms for real-time file access in Data Grids

Future Generation Computer Systems
Phoebus: A system for high throughput data movement

Journal of Parallel and Distributed Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

TCP is widely deployed and is used by GridFTP for data transfers within grid environments. Due to TCP dynamics, throughput of data transfers can be much lower than the available bandwidth in wide area networks. Splitting a TCP connection into segments has been shown to improve throughput in this setting. This paper presents a set of components that enable deployment of overlay networks that use split-TCP connections to improve GridFTP transfer performance. Emulation demonstrates the conditions for which, splitting a TCP connection is most useful and reveals a significant source of overhead. Empirical results demonstrate significant performance improvement despite using intermittent, passive throughput observations to choose proxies.