The File Mover: an efficient data transfer system for Grid applications

Authors:
C. Anglano;M. Canonico
Affiliations:
Dipt. di Informatica, Univ. del Piemonte Orientale, Alessandria, Italy;Dipt. di Informatica, Univ. del Piemonte Orientale, Alessandria, Italy
Venue:
CCGRID '04 Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid
Year:
2004

Citing 0
Cited 2

Scheduling data-intensive bags of tasks in P2P grids with bittorrent-enabled data distribution

Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networks
P2P file sharing for P2P computing

Multiagent and Grid Systems - Content management and delivery through P2P-based content networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present the File Mover, a data transfer system designed to optimize the transfer of potentially very large files. The File Mover relies on an overlay network architecture, where a set of machines cooperate in the transfer by forwarding among them portions of the files being transferred. Data transfer times are minimized by choosing, for each transfer the set of relays that maximize the expected throughput. Preliminary experiments show that the File Mover is able to profitably exploit existing network paths not chosen by IP routing algorithms, thereby enhancing file transfer performance.