Improving Throughput for Grid Applications with Network Logistics

Authors:
Martin Swany
Affiliations:
University of Delaware
Venue:
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Year:
2004

Citing 15
Cited 9

Introduction to algorithms

Introduction to algorithms
Connections with multiple congested gateways in packet-switched networks part 1: one-way traffic

ACM SIGCOMM Computer Communication Review
TCP Vegas: new techniques for congestion detection and avoidance

SIGCOMM '94 Proceedings of the conference on Communications architectures, protocols and applications
The macroscopic behavior of the TCP congestion avoidance algorithm

ACM SIGCOMM Computer Communication Review
Improving reliable transport and handoff performance in cellular wireless networks

Wireless Networks
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
The end-to-end effects of Internet path selection

Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication
PSockets: the case for application-level network striping for data intensive applications using high speed wide area networks

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Dynamically forecasting network performance using the Network Weather Service

Cluster Computing
Managing Data Storage in the Network

IEEE Internet Computing
Internet indirection infrastructure

Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
The Case for Resilient Overlay Networks

HOTOS '01 Proceedings of the Eighth Workshop on Hot Topics in Operating Systems
Data Logistics in Network Computing: The Logistical Session Layer

NCA '01 Proceedings of the IEEE International Symposium on Network Computing and Applications (NCA'01)
Building Performance Topologies for Computational Grids

International Journal of High Performance Computing Applications
Overcast: reliable multicasting with on overlay network

OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4

The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Mitigating the gateway bottleneck via transparent cooperative caching in wireless mesh networks

Ad Hoc Networks
Performance of a GridFTP overlay network

Future Generation Computer Systems
Using overlays for efficient data transfer over shared wide-area networks

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
A GridFTP Overlay Network Service

GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Improving GridFTP performance using the Phoebus session layer

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Performance- and economisation-oriented scheduling techniques for managing applications with QoS demands in grids

International Journal of Ad Hoc and Ubiquitous Computing
Phoebus: A system for high throughput data movement

Journal of Parallel and Distributed Computing
XCAT-C++: design and performance of a distributed CCA framework

HiPC'05 Proceedings of the 12th international conference on High Performance Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This work describes a technique for improving network performance in Grid environments that we refer to as "logistics." We demonstrate that by using storage and cooperative forwarding "in" the network, we can improve end to end throughput in many cases. Our approach uses TCP connections in series and offers performance benefits for high-bandwidth, high-latency networks. First, we examine the underlying causes of the logistical effect. Next, we present a graph based scheduling approach that can be solved quickly and, within our assumptions, optimally. Finally, we present a large-scale empirical evaluation of the system in order to validate our scheduling approach for taking advantage of network logistics. This study demonstrates performance improvement in many situations and aggregate speedup results are presented.