OMPIO: a modular software architecture for MPI I/O

Authors:
Mohamad Chaarawi;Edgar Gabriel;Rainer Keller;Richard L. Graham;George Bosilca;Jack J. Dongarra
Affiliations:
Department of Computer Science, University of Houston, Houston, TX;Department of Computer Science, University of Houston, Houston, TX;High Performance Computing Center Stuttgart (HLRS), Stuttgart, Germany;Oak Ridge National Laboratory, Oak Ridge, TN;Innovative Computing Laboratory, University of Tennessee, Knoxville, TN;Innovative Computing Laboratory, University of Tennessee, Knoxville, TN
Venue:
EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
Year:
2011

Citing 11
Cited 3

A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
On implementing MPI-IO portably and with high performance

Proceedings of the sixth workshop on I/O in parallel and distributed systems
A case study in application I/O on Linux clusters

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces

FRONTIERS '96 Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation
A Tool for Optimizing Runtime Parameters of Open MPI

Proceedings of the 15th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Evaluating Algorithms for Shared File Pointer Operations in MPI I/O

ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
Adaptable, metadata rich IO methods for portable high performance IO

IPDPS '09 Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing
Towards high performance cell segmentation in multispectral fine needle aspiration cytology of thyroid lesions

Computer Methods and Programs in Biomedicine
Analysis of the component architecture overhead in open MPI

PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Optimizing performance of parallel i/o operations for high performance computing

Optimizing performance of parallel i/o operations for high performance computing
Transparent log-based data storage in MPI-IO applications

PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface

Design and evaluation of nonblocking collective I/O operations

EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
On the usability of the MPI shared file pointer routines

EuroMPI'12 Proceedings of the 19th European conference on Recent Advances in the Message Passing Interface
Optimized process placement for collective I/O operations

Proceedings of the 20th European MPI Users' Group Meeting

Quantified Score

Hi-index	0.00

Visualization

Abstract

I/O is probably the most limiting factor on high-end machines for large scale parallel applications as of today. This paper introduces OMPIO, a new parallel I/O architecture for OpenMPI. OMPIO provides a highly modular approach to parallel I/O by separating I/O functionality into smaller units (frameworks) and an arbitrary number of modules in each framework. Furthermore, each framework has a customized selection criteria that determines which module to use depending on the functionality of the framework as well as external parameters.