High Performance Computing on Heterogeneous Clusters with the Madeleine II Communication Library

Authors:
Olivier Aumage;Luc Bougé;Lionel Eyraud;Guillaume Mercier;Raymond Namyst;Loïc Prylli;Alexandre Denis;Jean-François Méhaut
Affiliations:
LIP, ENS Lyon, 46, allée d'Italie, 69364 Lyon Cedex 07, France;LIP, ENS Lyon, 46, allée d'Italie, 69364 Lyon Cedex 07, France;LIP, ENS Lyon, 46, allée d'Italie, 69364 Lyon Cedex 07, France;LIP, ENS Lyon, 46, allée d'Italie, 69364 Lyon Cedex 07, France;LIP, ENS Lyon, 46, allée d'Italie, 69364 Lyon Cedex 07, France;LIP, ENS Lyon, 46, allée d'Italie, 69364 Lyon Cedex 07, France;IRISA, Campus de Beaulieu, 35042 RENNES Cedex, France;Université des Antilles-Guyane, Faculté des Sciences Exactes et Naturelles, Laboratoire TRIVIA, Campus de Fouillole, 97159 Pointe-à-Pitre, France
Venue:
Cluster Computing
Year:
2002

Citing 8
Cited 1

The Nexus approach to integrating multithreading and communication

Journal of Parallel and Distributed Computing - Special issue on multithreading for multiprocessors
Managing multiple communication methods in high-performance networked computing systems

Journal of Parallel and Distributed Computing - Special issue on workstation clusters and network-based computing
Efficient kernel support for reliable communication

SAC '98 Proceedings of the 1998 ACM symposium on Applied Computing
Fast Messages: Efficient, Portable Communication for Workstation Clusters and MPPs

IEEE Parallel & Distributed Technology: Systems & Technology
The Virtual Interface Architecture

IEEE Micro
SCI: Scalable Coherent Interface, Architecture and Software for High-Performance Compute Clusters

SCI: Scalable Coherent Interface, Architecture and Software for High-Performance Compute Clusters
Efficient Communications in Multithreaded Runtime Systems

Proceedings of the 11 IPPS/SPDP'99 Workshops Held in Conjunction with the 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing
Integrating Kernel Activations in a Multithreaded Runtime System on Top of LINUX

IPDPS '00 Proceedings of the 15 IPDPS 2000 Workshops on Parallel and Distributed Processing

POD acceleration of fully implicit solver for unsteady nonlinear flows and its application on grid architecture

Advances in Engineering Software

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces Madeleine II, a new adaptive and portable multi-protocol implementation of the Madeleine communication library. Madeleine II has the ability to control multiple network interfaces (BIP, SISCI, VIA) and multiple network adapters (Ethernet, Myrinet, SCI) within the same application session. We report on performance measurements obtained using BIP/Myrinet and SISCI/SCI and we present preliminary results about our MPICH/Madeleine II and Nexus/Madeleine II ports. We also discuss an extension of Madeleine II for clusters of clusters which is able to handle heterogeneous networks. In particular, we present the fast internal data-forwarding mechanism that is used on gateway nodes to speed up inter-cluster transmissions. Preliminary experiments show that the resulting inter-cluster bandwidth is close to the one delivered by the hardware.