Optimising MPI Applications for Heterogeneous Coupled Clusters with MetaMPICH

Authors:
Carsten Clauss;Martin Poppe;Thomas Bemmerl
Affiliations:
RWTH Aachen University, Germany;RWTH Aachen University, Germany;RWTH Aachen University, Germany
Venue:
PARELEC '04 Proceedings of the international conference on Parallel Computing in Electrical Engineering
Year:
2004

Citing 0
Cited 3

MGF: A grid-enabled MPI library

Future Generation Computer Systems
The new multidevice architecture of MetaMPICH in the context of other approaches to grid-enabled MPI

EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Expanding the volunteer computing scenario: A novel approach to use parallel applications on volunteer computing

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Cluster systems built mainly from commodity hardware components have become more and more usable for high performance computing tasks in the past few years. To increase the parallelism for applications, it is often desirable to combine those clusters to a higher lever, commonly called metacomputer. This class of high performance computing platforms can be understood as a cluster of clusters, where each cluster provides different processors, memory performance, cluster interconnect and external networking facilities. Our project called MetaMPICH provides a transparent MPI-1 implementation for those inhomogeneous cluster systems. While this feature of transparency makes porting existing MPI applications to metacomputers quite simple, the slowest network connection and the slowest processor will dominate the performance and scalability due to the lack of opacity. This paper describes our approaches to adapt iterative, grid based simulation algorithms to the structures of such heterogeneous coupled clusters.