Implementation of a dynamic adjustment strategy for parallel file transfer in co-allocation data grids

  • Authors:
  • Chao-Tung Yang;Shih-Yu Wang;William Cheng-Chung Chu

  • Affiliations:
  • Department of Computer Science, Tunghai University, Taichung, Taiwan 40704;Department of Computer Science, Tunghai University, Taichung, Taiwan 40704 and Communication System Division Service-Oriented Network System Department, Information and Communications Research Lab ...;Department of Computer Science, Tunghai University, Taichung, Taiwan 40704

  • Venue:
  • The Journal of Supercomputing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Co-allocation architecture was developed to enable parallel transferring of files from multiple replicas stored in the different servers. Several co-allocation strategies have been coupled and used to exploit the different transfer rates among various client-server links and to address dynamic rate fluctuations by dividing files into multiple blocks of equal sizes. The paper presents a dynamic file transfer scheme, called dynamic adjustment strategy (DAS), for co-allocation architecture in concurrently transferring a file from multiple replicas stored in multiple servers within a data grid. The scheme overcomes the obstacle of transfer performance due to idle waiting time of faster servers in co-allocation based file transfers and, therefore, provides reduced file transfer time. A tool with user friendly interface that can be used to manage replicas and downloading in a data grid environment is also described. Experimental results show that our DAS can obtain high-performance file transfer speed and reduce the time cost of reassembling data blocks.