Adaptive Load Balancing for MPI Programs

Authors:
Milind A. Bhandarkar;Laxmikant V. Kalé;Eric de Sturler;Jay Hoeflinger
Affiliations:
-;-;-;-
Venue:
ICCS '01 Proceedings of the International Conference on Computational Science-Part II
Year:
2001

Citing 10
Cited 21

Using MPI: portable parallel programming with the message-passing interface

Using MPI: portable parallel programming with the message-passing interface
Compile/run-time support for threaded MPI execution on multiprogrammed shared memory machines

Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming
NAMD2: greater scalability for parallel molecular dynamics

Journal of Computational Physics - Special issue on computational molecular biophysics
Virtual Rocketry: Rocket Science Meets Computer Science

IEEE Computational Science & Engineering
A Parallel Framework for Explicit FEM

HiPC '00 Proceedings of the 7th International Conference on High Performance Computing
An Efficient and Transparent Thread Migration Scheme in the PM2 Runtime System

Proceedings of the 11 IPPS/SPDP'99 Workshops Held in Conjunction with the 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing
Polaris: Improving the Effectiveness of Parallelizing Compilers

LCPC '94 Proceedings of the 7th International Workshop on Languages and Compilers for Parallel Computing
Parallel Processing on Dynamic Resources with CARMI

IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Adapting to Load on Workstation Clusters

FRONTIERS '99 Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation
Autopilot: Adaptive Control of Distributed Applications

HPDC '98 Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing

ATOP-space and time adaptation for parallel and grid applications via flexible data partitioning

ARM '04 Proceedings of the 3rd workshop on Adaptive and reflective middleware
Dyn-MPI: Supporting MPI on Non Dedicated Clusters

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Just In Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Scaling applications to massively parallel machines using Projections performance analysis tool

Future Generation Computer Systems
HeteroMPI: Towards a message-passing library for heterogeneous networks of computers

Journal of Parallel and Distributed Computing
Dyn-MPI: Supporting MPI on medium-scale, non-dedicated clusters

Journal of Parallel and Distributed Computing
A taxonomy of market-based resource management systems for utility-driven cluster computing

Software—Practice & Experience
Regular Paper: Load-Balanced Drift-Diffusion Model Simulation: Cluster Software Performance Evaluation

International Journal of High Performance Computing Applications
Malleable applications for scalable high performance computing

Cluster Computing
Time and space adaptation for computational grids with the ATOP-Grid middleware

Future Generation Computer Systems
Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs

Journal of Parallel and Distributed Computing
A Case Study of Communication Optimizations on 3D Mesh Interconnects

Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
Scaling molecular dynamics to 3000 processors with projections: a performance analysis case study

ICCS'03 Proceedings of the 2003 international conference on Computational science
Jade: a parallel message-driven java

ICCS'03 Proceedings of the 2003 international conference on Computational science: PartIII
Dynamic load balancing in MPI jobs

ISHPC'05/ALPS'06 Proceedings of the 6th international symposium on high-performance computing and 1st international conference on Advanced low power systems
High-performance finite-element simulations of seismic wave propagation in three-dimensional nonlinear inelastic geological media

Parallel Computing
A moving threads processor architecture MTPA

The Journal of Supercomputing
An architecture for reconfigurable iterative MPI applications in dynamic environments

PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
Robotic clusters: Multi-robot systems as computer clusters

Robotics and Autonomous Systems
Enabling MPI interoperability through flexible communication endpoints

Proceedings of the 20th European MPI Users' Group Meeting
Review: A survey on resource allocation in high performance distributed computing systems

Parallel Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Parallel Computational Science and Engineering (CSE) applications often exhibit irregular structure and dynamic load patterns. Many such applications have been developed using MPI. Incorporating dynamic load balancing techniques at the application-level involves significant changes to the design and structure of applications. On the other hand, traditional run-time systems for MPI do not support dynamic load balancing. Object-based parallel programming languages, such as Charm++ support efficient dynamic load balancing using object migration. However, converting legacy MPI applications to such object-based paradigms is cumbersome. This paper describes an implementation of MPI, called Adaptive MPI (AMPI) that supports dynamic load balancing for MPI applications. Conversion from MPI to this platform is straightforward even for large legacy codes. We describe our positive experience in converting the component codes ROCFLO and ROCSOLID of a Rocket Simulation application to AMPI.