Implementing a Parallel NetCDF Interface for Seamless Remote I/O Using Multi-dimensional Data

Authors:
Yuichi Tsujita
Affiliations:
Department of Electronic Engineering and Computer Science, School of Engineering, Kinki University, Hiroshima, Japan 739-2116
Venue:
High Performance Computing for Computational Science - VECPAR 2008
Year:
2008

Citing 8
Cited 0

A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
On implementing MPI-IO portably and with high performance

Proceedings of the sixth workshop on I/O in parallel and distributed systems
A case study in application I/O on Linux clusters

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Distributed Computing in a Heterogeneous Computing Environment

Proceedings of the 5th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Stampi-I/O: A Flexible Parallel-I/O Library for Heterogeneous Computing Environment

Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces

FRONTIERS '96 Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation
Parallel netCDF: A High-Performance Scientific I/O Interface

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
RFS: efficient and flexible remote file access for MPI-IO

CLUSTER '04 Proceedings of the 2004 IEEE International Conference on Cluster Computing

Quantified Score

Hi-index	0.01

Visualization

Abstract

Parallel netCDF supports parallel I/O operations for a view of data as a collection of self-describing, portable, and array-oriented objects that can be accessed through a simple interface. Its parallel I/O operations are realized with the help of an MPI-I/O library. However, such the operations are not available in remote I/O operations. So, a remote I/O mechanism of a Stampi library was introduced in an MPI layer of the parallel netCDF to realize such the operations. This system was evaluated on two interconnected PC clusters, and sufficient performance was achieved with a huge amount of data.