Integrating Logical and Physical File Models in the MPI-IO Implementation for "Clusterfile"

Authors:
Florin Isaila;David Singh;Jesus Carretero;Felix Garcia;Gabor Szeder;Thomas Moschny
Affiliations:
University Carlos III of Madrid, Spain;University Carlos III of Madrid, Spain;University Carlos III of Madrid, Spain;University Carlos III of Madrid, Spain;University of Karlsruhe, Germany;University of Karlsruhe, Germany
Venue:
CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
Year:
2006

Citing 0
Cited 2

Implementation and Evaluation of File Write-Back and Prefetching for MPI-IO Over GPFS

International Journal of High Performance Computing Applications
A Scalable Message Passing Interface Implementation of an Ad-Hoc Parallel I/o system

International Journal of High Performance Computing Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the design and implementation of the MPI-IO interface for the Clusterfile parallel file system. The approach offers the opportunity of achieving a high corelation between the file access patterns of parallel applications and the physical file distribution. First, any physical file distribution can be expressed by means of MPI data types. Second, mechanisms such as views and collective I/O operations are portably implemented inside the file system, unifying the I/O scheduling strategies of the MPI-IO library and the file system. The experimental section demonstrates performance benefits of more than one order of magnitude.