Efficient Multi-Source Data Transfer in Data Grids

  • Authors:
  • Chien-Min Wang;Chun-Chen Hsu;Hsi-Min Chen;Jan-Jan Wu

  • Affiliations:
  • Academia Sinica, Taiwan;Academia Sinica, Taiwan;National Central University, Taiwan;Academia Sinica, Taiwan

  • Venue:
  • CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

As the number of data-intensive applications increases in various domains, scientists need to save, retrieve, and analyze increasingly large datasets. The huge volume of data and the long latency of data transfer on the Internet make it very difficult to ensure high-performance access to Data Grids. Thus, data replication techniques have been widely adopted to solve the latency problem. In this paper, we propose an efficient data replication algorithm for multi-source data transfer, whereby a data replica can be assembled in parallel from multiple distributed data sources and adapted to the variability of network bandwidths. The experimental results show that the proposed algorithm can obtain more aggregated bandwidth, reduce connection overheads, and achieve superior load balance.