Scalable Bulk Data Transfer in Wide Area Networks

Authors:
Nader Mohamed;Jameela Al-Jaroodi;Hong Jiang;David Swanson
Affiliations:
-;-;-;DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING, UNIVERSITY OF NEBRASKA - LINCOLN, LINCOLN, NE 68588-0115, USA
Venue:
International Journal of High Performance Computing Applications
Year:
2003

Citing 12
Cited 3

A reliable and scalable striping protocol

Conference proceedings on Applications, technologies, architectures, and protocols for computer communications
Modeling communication pipeline latency

SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
PSockets: the case for application-level network striping for data intensive applications using high speed wide area networks

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
NILE: wide-area computing for high energy physics

EW 7 Proceedings of the 7th workshop on ACM SIGOPS European workshop: Systems support for worldwide applications
WebFlow: high-level programming environment and visual authoring toolkit for high performance distributed computing

SC '98 Proceedings of the 1998 ACM/IEEE conference on Supercomputing
High Performance Wide Area Data Transfers over High Performance Networks

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
The SDSC storage resource broker

CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
Reliable Blast UDP: Predictable High Performance Bulk Data Transfer

CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
A Network-Aware Distributed Storage Cache for Data Intensive Environments

HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
An Evaluation of Object-Based Data Transfers on High Performance Networks

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
The Grid 2: Blueprint for a New Computing Infrastructure

The Grid 2: Blueprint for a New Computing Infrastructure
Striping within the network subsystem

IEEE Network: The Magazine of Global Internetworking

Research note: Dependable user-level socket over dual networks

Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
High-performance message striping over reliable transport protocols

The Journal of Supercomputing
Self-configured multiple-network-interface socket

Journal of Network and Computer Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Bulk data transfer in wide area networks (WAN) requires scalable and high network bandwidth. In this paper, we identify a number of the scalability limitations that affect the full utilization of peak theoretical network bandwidth. In addition, we study and classify different offered approaches to overcome some of the identified limitations and increase network bandwidth among Grid components in WAN. With these limitations in mind, we study and evaluate the scalability and flexibility of a UDP-based multiple-network-interface socket (MuniSocket) model in WAN. The MuniSocket model is a middleware layer between the distributed applications and the multiple networks and system resources available. MuniSocket utilizes existing system resources, network interface cards, and network links to provide a scalable, reliable and high bandwidth network solution for data-intensive distributed applications, thus eliminating most of the identified limitations.