A Tool for Optimizing Runtime Parameters of Open MPI

Authors:
Mohamad Chaarawi;Jeffrey M. Squyres;Edgar Gabriel;Saber Feki
Affiliations:
Parallel Software Technologies Laboratory, Department of Computer Science, University of Houston, and Cisco Systems, San Jose, USA;Cisco Systems, San Jose, USA;Parallel Software Technologies Laboratory, Department of Computer Science, University of Houston,;Parallel Software Technologies Laboratory, Department of Computer Science, University of Houston,
Venue:
Proceedings of the 15th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Year:
2008

Citing 5
Cited 4

A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
SKaMPI: A Detailed, Accurate MPI Benchmark

Proceedings of the 5th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Protocol-Dependent Message-Passing Performance on Linux Clusters

CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
Minimizing development and maintenance costs in supporting persistently optimized BLAS

Software—Practice & Experience - Research Articles
Performance analysis of MPI collective operations

Cluster Computing

Optimizing MPI Runtime Parameter Settings by Using Machine Learning

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Locality and topology aware intra-node communication among multicore CPUs

EuroMPI'10 Proceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface
OMPIO: a modular software architecture for MPI I/O

EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
Methodology for MPI applications autotuning

Proceedings of the 20th European MPI Users' Group Meeting

Quantified Score

Hi-index	0.00

Visualization

Abstract

Clustered computing environments, although becoming the predominant high-performance computing platform of choice, continue to grow in complexity. It is relatively easy to achieve goodperformance with real-world MPI applications on such platforms, but obtaining the best possible MPI performance is still an extremely difficult task, requiring painstaking tuning of all levels of the hardware and software in the system. The Open Tool for Parameter Optimization (OTPO) is a new framework designed to aid in the optimization of one of the key software layers in high performance computing: Open MPI. OTPO systematically tests large numbers of combinations of Open MPI's run-time tunable parameters for common communication patterns and performance metrics to determine the "best" set for a given platform. This paper presents the concept, some implementation details and the current status of the tool, as well as an example optimizing InfiniBand message passing latency by Open MPI.