Fast and scalable startup of MPI programs in infiniband clusters

Authors:
Weikuan Yu;Jiesheng Wu;Dhabaleswar K. Panda
Affiliations:
Network-Based Computing Lab, Dept of Computer Science and Engineering, The Ohio State University;Network-Based Computing Lab, Dept of Computer Science and Engineering, The Ohio State University;Network-Based Computing Lab, Dept of Computer Science and Engineering, The Ohio State University
Venue:
HiPC'04 Proceedings of the 11th international conference on High Performance Computing
Year:
2004

Citing 7
Cited 3

A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
Using multicast to pre-load jobs on the ParPar cluster

Parallel Computing
BProc: the Beowulf distributed process space

ICS '02 Proceedings of the 16th international conference on Supercomputing
Components and interfaces of a process management system for parallel programs

Parallel Computing - Clusters and computational grids for scientific computing
Scalable parallel application launch on Cplant™

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
STORM: lightning-fast resource management

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Impact of On-Demand Connection Management in MPI over VIA

CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing

A case for high performance computing with virtual machines

Proceedings of the 20th annual international conference on Supercomputing
TakTuk, adaptive deployment of remote executions

Proceedings of the 18th ACM international symposium on High performance distributed computing
Adaptive connection management for scalable MPI over InfiniBand

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

One of the major challenges in parallel computing over large scale clusters is fast and scalable process startup, which typically can be divided into two phases: process initiation and connection setup In this paper, we characterize the startup of MPI programs in InfiniBand clusters and identify two startup scalability issues: serialized process initiation in the initiation phase and high communication overhead in the connection setup phase To reduce the connection setup time, we have developed one approach with data reassembly to reduce data volume, and another with a bootstrap channel to parallelize the communication Furthermore, a process management framework, Multi-Purpose Daemons (MPD) system is exploited to speed up process initiation Our experimental results show that job startup time has been improved by more than 4 times for 128-process jobs, and the improvement can be more than two orders of magnitude for 2048-process jobs as suggested by our analytical models.