MAPFS: a flexible multiagent parallel file system for clusters

  • Authors:

  • María S. Pérez;Jesús Carretero;Félix García;José M. Peña;Víctor Robles

  • Affiliations:

  • Department of Computer Architecture and Technology, Technical University of Madrid, Madrid, Spain;Department of Computer Science, University Carlos III of Madrid, Spain;Department of Computer Science, University Carlos III of Madrid, Spain;Department of Computer Architecture and Technology, Technical University of Madrid, Madrid, Spain;Department of Computer Architecture and Technology, Technical University of Madrid, Madrid, Spain

  • Venue:
  • Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The emergence of applications with greater processing and speedup requirements, such as Grand Challenge Applications (GCA), involves new computing and I/O needs. Many of these applications require access to huge data repositories and other I/O sources, making the I/O phase a bottleneck in the computing systems, due to its poor performance. In this sense, parallel I/O is becoming one of the major topics in the area of high-performance systems. Existing data-intensive GCA have been used in several domains, such as high energy physics, climate modeling, biology or visualization. Since the I/O problem has not been solved in this kind of applications, new approaches are required in this case. This paper presents MAPFS, a multiagent architecture, whose goal is to allow applications to access data in a cluster of workstations in an efficient and flexible fashion, providing formalisms for modifying the topology of the storage system, specifying different data access patterns and selecting additional functionalities.