The macroscopic behavior of the TCP congestion avoidance algorithm
ACM SIGCOMM Computer Communication Review
Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Data management and transfer in high-performance computational grid environments
Parallel Computing - Parallel data-intensive algorithms and applications
DataSpace: A Data Web for the Exploratory Analysis and Mining of Data
Computing in Science and Engineering
Congestion control for high bandwidth-delay product networks
Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Reliable Blast UDP: Predictable High Performance Bulk Data Transfer
CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
Experimental studies using photonic data services at IGrid 2002
Future Generation Computer Systems - iGrid 2002
TransLight: a global-scale LambdaGrid for e-science
Communications of the ACM - Blueprint for the future of high-performance networking
Simple Available Bandwidth Utilization Library for High-Speed Wide Area Networks
The Journal of Supercomputing
An Analytical Comparison of the Slow-but-Steady and Impatient Variants of TCP New Reno
WWIC '07 Proceedings of the 5th international conference on Wired/Wireless Internet Communications
| Hi-index | 0.00 |
Although the amount of earth-science data is growing rapidly, as is the availability of high-performance networks, our ability to access large remote earth-science data sets is still very limited. This is particularly true of networks with high bandwidth-delay products (BDP), such as those between the US and Europe. Recently, several network protocols have emerged that improve the situation and hold the promise of being much more effective than striped TCP (wherein multiple, parallel connections are used to increase data throughput). In this paper, we report on experimental studies using one of these new protocols called UDT, and compare UDT to other approaches. In addition, we consider the effectiveness of these new protocols when reading and writing data to and from disk over high BDP networks. We also consider the problem of accessing remote data by attribute over these same networks. We show that with the appropriate protocol, the speed of accessing data across the Atlantic can be improved significantly. We note that the UDT protocol used here can be deployed as an application library for earth-science applications and neither requires upgrades to existing network infrastructure, such as routers, nor to the Linux kernels on the servers involved.