Implementing MPI-IO atomic mode without file system support

Authors:
R. Ross;R. Latham;W. Gropp;R. Thakur;B. Toonen
Affiliations:
Div. of Math. & Comput. Sci., Argonne Nat. Lab., IL, USA;Div. of Math. & Comput. Sci., Argonne Nat. Lab., IL, USA;Div. of Math. & Comput. Sci., Argonne Nat. Lab., IL, USA;Div. of Math. & Comput. Sci., Argonne Nat. Lab., IL, USA;Div. of Math. & Comput. Sci., Argonne Nat. Lab., IL, USA
Venue:
CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2 - Volume 02
Year:
2005

Citing 0
Cited 10

Implementing MPI-IO Atomic Mode and Shared File Pointers Using MPI One-Sided Communication

International Journal of High Performance Computing Applications
Using MPI file caching to improve parallel write performance for large-scale scientific applications

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Noncontiguous locking techniques for parallel file systems

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Dynamically adapting file domain partitioning methods for collective I/O based on underlying parallel file system locking protocols

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Scaling parallel I/O performance through I/O delegate and caching system

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Conflict Detection Algorithm to Minimize Locking for MPI-IO Atomicity

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Implementing MPI-IO shared file pointers without file system support

PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Implementing byte-range locks using MPI one-sided communication

PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Transparent Accelerator Migration in a Virtualized GPU Environment

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
On the usability of the MPI shared file pointer routines

EuroMPI'12 Proceedings of the 19th European conference on Recent Advances in the Message Passing Interface

Quantified Score

Hi-index	0.00

Visualization

Abstract

The ROMIO implementation of the MPI-IO standard provides a portable infrastructure for use on top of any number of different underlying storage targets. These different targets vary widely in their capabilities, and in some cases, additional effort is needed within ROMIO to support the complete MPI-IO semantics. One aspect of the interface that can be problematic to implement is the MPI-IO atomic mode. This mode requires enforcing strict consistency semantics. For some file systems, native locks may be used to enforce these semantics, but not all file systems have lock support. In this work, we describe two algorithms for implementing efficient mutex locks using MPI-1 and MPI-2 capabilities. We then show how these algorithms may be used to implement a portable MPI-IO atomic mode for ROMIO. We evaluate the performance of these algorithms and show that they impose little additional overhead on the system. Because of the low-overhead nature of these algorithms, they are likely useful in a variety of situations where distributed locks are needed in the MPI-2 environment.