A study of real world I/O performance in parallel scientific computing

Authors:
Dries Kimpe;Andrea Lani;Tiago Quintino;Stefan Vandewalle;Stefaan Poedts;Herman Deconinck
Affiliations:
Technisch-Wetenschappelijk Rekenen, K.U.Leuven, Leuven, België and Centrum voor Plasma-Astrofysica, K.U.Leuven, Leuven, België;Von Karman Instituut, België;Technisch-Wetenschappelijk Rekenen, K.U.Leuven, Leuven, België and Von Karman Instituut, België;Technisch-Wetenschappelijk Rekenen, K.U.Leuven, Leuven, België;Centrum voor Plasma-Astrofysica, K.U.Leuven, Leuven, België;Von Karman Instituut, België
Venue:
PARA'06 Proceedings of the 8th international conference on Applied parallel computing: state of the art in scientific computing
Year:
2006

Citing 5
Cited 0

A case for using MPI's derived datatypes to improve I/O performance

SC '98 Proceedings of the 1998 ACM/IEEE conference on Supercomputing
An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces

FRONTIERS '96 Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation
Data Sieving and Collective I/O in ROMIO

FRONTIERS '99 Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation
Parallel netCDF: A High-Performance Scientific I/O Interface

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
The COOLFluiD framework: design solutions for high performance object oriented scientific computing software

ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Parallel computing is indisputably present in the future of high performance computing. For distributed memory systems, MPI is widely accepted as a de facto standard. However, I/O is often neglected when considering parallel performance. In this article, a number of I/O strategies for distributed memory systems will be examined. These will be evaluated in the context of COOLFluiD, a framework for object oriented computational fluid dynamics. The influence of the system and software architecture on performance will be studied. Benchmark results will be provided, enabling a comparison between some commonly used parallel file systems.