Improving GridFTP transfers by means of a multiagent parallel file system

Authors:
Alberto Sánchez;María S. Pérez;Pierre Gueant;Jesús Montes;Pilar Herrero;Toni Cortes
Affiliations:
Facultad de Informática, UPM, Campus de Montegancedo s/n, Boadilla del Monte, Madrid, Spain. Barcelona Supercomputing Center (BSC), Torre Girona. c/ Jordi Girona 31, Barcelona, Spain;Facultad de Informática, UPM, Campus de Montegancedo s/n, Boadilla del Monte, Madrid, Spain. Barcelona Supercomputing Center (BSC), Torre Girona. c/ Jordi Girona 31, Barcelona, Spain;Facultad de Informática, UPM, Campus de Montegancedo s/n, Boadilla del Monte, Madrid, Spain. Barcelona Supercomputing Center (BSC), Torre Girona. c/ Jordi Girona 31, Barcelona, Spain;Facultad de Informática, UPM, Campus de Montegancedo s/n, Boadilla del Monte, Madrid, Spain. Barcelona Supercomputing Center (BSC), Torre Girona. c/ Jordi Girona 31, Barcelona, Spain;Facultad de Informática, UPM, Campus de Montegancedo s/n, Boadilla del Monte, Madrid, Spain. Barcelona Supercomputing Center (BSC), Torre Girona. c/ Jordi Girona 31, Barcelona, Spain;Facultad de Informática, UPM, Campus de Montegancedo s/n, Boadilla del Monte, Madrid, Spain. Barcelona Supercomputing Center (BSC), Torre Girona. c/ Jordi Girona 31, Barcelona, Spain
Venue:
Multiagent and Grid Systems - Grid Computing, high performance and distributed applications
Year:
2007

Citing 19
Cited 0

Using MPI: portable parallel programming with the message-passing interface

Using MPI: portable parallel programming with the message-passing interface
KQML as an agent communication language

Software agents
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
OceanStore: an architecture for global-scale persistent storage

ASPLOS IX Proceedings of the ninth international conference on Architectural support for programming languages and operating systems
Data management and transfer in high-performance computational grid environments

Parallel Computing - Parallel data-intensive algorithms and applications
The SDSC storage resource broker

CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
A Network-Aware Distributed Storage Cache for Data Intensive Environments

HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
A New MultiAgent Based Architecture for High Performance I/O in Clusters

ICPPW '01 Proceedings of the 2001 International Conference on Parallel Processing Workshops
Darwin: Customizable Resource Management for Value-Added Network Services

ICNP '98 Proceedings of the Sixth International Conference on Network Protocols
Brain Meets Brawn: Why Grid and Agents Need Each Other

AAMAS '04 Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 1
Dynamic Resource Selection For Service Composition in The Grid

WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
High Performance Storage System Scalability: Architecture, Implementation and Experience

MSST '05 Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies
Trust in multi-agent systems

The Knowledge Engineering Review
The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A new formalism for dynamic reconfiguration of data servers in a cluster

Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
A framework for reliable and efficient data placement in distributed computing systems

Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
MAPFS: a flexible multiagent parallel file system for clusters

Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
MAPFS-DAI, an extension of OGSA-DAI based on a parallel file system

Future Generation Computer Systems - Special section: Data mining in grid computing environments
An agent architecture for managing data resources in a grid environment

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Data transfer in a grid environment has become one critical activity in a large number of applications that require access to huge volumes of data. In these scenarios, characterized by large latencies, poor performance and complex dependencies, the use of approaches such as multiagents or parallel I/O can provide a great benefit. However, all the attempts to improve the performance of data transfer in grids should achieve the interoperability with already established data transfer schemes. GridFTP is one of the most known and used data grid transfer protocols. This paper describes MAPFS-DSI, a modification of the GridFTP server, based on a multiagent parallel file system. MAPFS-DSI increases the performance of data transfers, but keeping the interoperability with existing GridFTP servers.