On implementing MPI-IO portably and with high performance
Proceedings of the sixth workshop on I/O in parallel and distributed systems
Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Using MPI-2: Advanced Features of the Message Passing Interface
Using MPI-2: Advanced Features of the Message Passing Interface
MPI-IO on a Parallel File System for Cluster of Workstations
IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
Toward Scalable Performance Visualization with Jumpshot
International Journal of High Performance Computing Applications
PVFS: a parallel file system for linux clusters
ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
Advances in Engineering Software
Parallel netCDF: A High-Performance Scientific I/O Interface
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
CEFT: A cost-effective, fault-tolerant parallel virtual file system
Journal of Parallel and Distributed Computing
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
A case study of parallel I/O for biological sequence search on Linux clusters
International Journal of High Performance Computing and Networking
Integrating parallel file systems with object-based storage devices
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Implementing a Parallel NetCDF Interface for Seamless Remote I/O Using Multi-dimensional Data
High Performance Computing for Computational Science - VECPAR 2008
Armazenamento distribuído de imagens médicas DICOM no formato de dados HDF5
Proceedings of the 14th Brazilian Symposium on Multimedia and the Web
Parallel I/O scheduling in multiprogrammed cluster computing systems
ICCS'03 Proceedings of the 2003 international conference on Computational science
An architecture for DICOM medical images storage and retrieval adopting distributed file systems
International Journal of High Performance Systems Architecture
OMPIO: a modular software architecture for MPI I/O
EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
PMPS(3): a performance model of parallel systems
ACSAC'06 Proceedings of the 11th Asia-Pacific conference on Advances in Computer Systems Architecture
Performance analysis of Intel multiprocessors using astrophysics simulations
Concurrency and Computation: Practice & Experience
Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
| Hi-index | 0.00 |
A critical but often ignored component of system performance is the I/O system. Today's applications demand a great deal from underlying storage systems and software, and both high-performance distributed storage and high level interfaces have been developed to fill these needs.In this paper we discuss the I/O performance of a parallel scientific application on a Linux cluster, the FLASH astrophysics code. This application relies on three I/O software components to provide high-performance parallel I/O on Linux clusters: the Parallel Virtual File System, the ROMIO MPI-IO implementation, and the Hierarchical Data Format library. Through instrumentation of both the application and underlying system software code we discover the location of major software bottlenecks. We work around the most inhibiting of these bottlenecks, showing substantial performance improvement. We point out similarities between the inefficiencies found here and those found in message passing systems, indicating that research in the message passing field could be leveraged to solve similar problems in high-level I/O interfaces.