Grid-enabled particle physics event analysis: experiences using a 10 Gb, high-latency network for a high-energy physics application

Authors:
W. Allcock;J. Bresnahan;J. Bunn;S. Hegde;J. Insley;R. Kettimuthu;H. Newman;S. Ravot;T. Rimovsky;C. Steenberg;L. Winkler
Affiliations:
Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL;Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL;California Institute of Technology, Pasadena, CA;Illinois Institute of Technology, Chicago, IL;Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL;The Ohio State University, Columbus, OH;California Institute of Technology, Pasadena, CA;California Institute of Technology, Pasadena, CA;National Center for Supercomputing Applications, Urbana, IL;California Institute of Technology, Pasadena, CA;Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL
Venue:
Future Generation Computer Systems - iGrid 2002
Year:
2003

Citing 7
Cited 4

TCP/IP illustrated (vol. 1): the protocols

TCP/IP illustrated (vol. 1): the protocols
Forward acknowledgement: refining TCP congestion control

Conference proceedings on Applications, technologies, architectures, and protocols for computer communications
The failure of TCP in high-performance computational grids

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Data management and transfer in high-performance computational grid environments

Parallel Computing - Parallel data-intensive algorithms and applications
GridMapper: A Tool for Visualizing the Behavior of Large-Scale Distributed Systems

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
PVFS: a parallel file system for linux clusters

ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
TCP Vegas: end to end congestion avoidance on a global Internet

IEEE Journal on Selected Areas in Communications

Data mining middleware for wide-area high-performance networks

Future Generation Computer Systems - IGrid 2005: The global lambda integrated facility
StReD: A quality of security framework for storage resources in Data Grids

Future Generation Computer Systems
Design and analysis of a load balancing strategy in data grids

Future Generation Computer Systems - Special section: Data mining in grid computing environments
A study on performance of dynamic file replication algorithms for real-time file access in Data Grids

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper examines issues encountered attempting to exploit a high-bandwidth, high-latency link in support of a high-energy physics (HEP) analysis application. The primary issue was that the TCP additive increase/multiplicative decrease (AIMD) algorithm is not suitable for "long fat networks". While this is a known problem, the magnitude of the impact on application performance was much greater than anticipated. We were able to overcome much of the impact, by altering the AIMD coefficients. Such an approach, of course, is non-TCP compliant, and there was insufficient time to test the network friendliness of these modifications.