Automatic resource-centric process migration for MPI

Authors:
Amnon Barak;Alexander Margolin;Amnon Shiloh
Affiliations:
Department of Computer Science, The Hebrew University of Jerusalem, Israel;Department of Computer Science, The Hebrew University of Jerusalem, Israel;Department of Computer Science, The Hebrew University of Jerusalem, Israel
Venue:
EuroMPI'12 Proceedings of the 19th European conference on Recent Advances in the Message Passing Interface
Year:
2012

Citing 10
Cited 0

An Opportunity Cost Approach for Job Assignment in a Scalable Computing Cluster

IEEE Transactions on Parallel and Distributed Systems
M-JavaMPI: A Java-MPI Binding with Process Migration Support

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Dynamic Load Balancing of MPI+OpenMP Applications

ICPP '04 Proceedings of the 2004 International Conference on Parallel Processing
Performance evaluation of adaptive MPI

Proceedings of the eleventh ACM SIGPLAN symposium on Principles and practice of parallel programming
Application-Transparent Checkpoint/Restart for MPI Programs over InfiniBand

ICPP '06 Proceedings of the 2006 International Conference on Parallel Processing
Proactive process-level live migration in HPC environments

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Interconnect agnostic checkpoint/restart in open MPI

Proceedings of the 18th ACM international symposium on High performance distributed computing
Randomized gossip algorithms for maintaining a distributed bulletin board with guaranteed age properties

Concurrency and Computation: Practice & Experience
A Novel Process Migration Method for MPI Applications

PRDC '09 Proceedings of the 2009 15th IEEE Pacific Rim International Symposium on Dependable Computing
RDMA-Based Job Migration Framework for MPI over InfiniBand

CLUSTER '10 Proceedings of the 2010 IEEE International Conference on Cluster Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Process migration refers to the ability to move a running process from one node and make it continue on another. The MPI standard prescribes support for process migration, but so far it was implemented mostly via checkpoint-restart. This paper presents an automatic and transparent process migration framework that can be used for MPI processes. This framework is advantageous when migration of individual processes for purposes such as load-balancing is more adequate than checkpointing the whole job. The paper describes this framework for process migration in clusters and multi-clusters, how it was tuned for Open MPI and the performance of migrated MPI processes.