Design and evaluation of nonblocking collective I/O operations

Authors:
Vishwanath Venkatesan;Mohamad Chaarawi;Edgar Gabriel;Torsten Hoefler
Affiliations:
Department of Computer Science, University of Houston;Department of Computer Science, University of Houston;Department of Computer Science, University of Houston;Blue Waters Directorate, University of Illinois
Venue:
EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
Year:
2011

Citing 8
Cited 1

Optimizing Metacomputing with Communication-Computation Overlap

PaCT '01 Proceedings of the 6th International Conference on Parallel Computing Technologies
An Evaluation of Current High-Performance Networks

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
An analysis of the impact of MPI overlap and independent progress

Proceedings of the 18th annual international conference on Supercomputing
Optimizing a conjugate gradient solver with non-blocking collective operations

Parallel Computing
Implementation and performance analysis of non-blocking collective operations for MPI

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Performance Evaluation of Collective Write Algorithms in MPI I/O

ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
Towards high performance cell segmentation in multispectral fine needle aspiration cytology of thyroid lesions

Computer Methods and Programs in Biomedicine
OMPIO: a modular software architecture for MPI I/O

EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface

Design and Implementation of Portable and Efficient Non-blocking Collective Communication

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Nonblocking operations have successfully been used to hide network latencies in large scale parallel applications. This paper presents the challenges associated with developing nonblocking collective I/O operations, in order to help hiding the costs of I/O operations. We also present an implementation based on the libNBC library, and evaluate the benefits of nonblocking collective I/O over a PVFS2 file system for a micro-benchmark and a parallel image processing application. Our results indicate the potential benefit of our approach, but also highlight the challenges to achieve appropriate overlap between I/O and compute operations.