Making wide-area, multi-site MPI feasible using xen VM

Authors:
Masaki Tatezono;Naoya Maruyama;Satoshi Matsuoka
Affiliations:
Tokyo Institute of Technology, Tokyo, Japan;Tokyo Institute of Technology, Tokyo, Japan;Tokyo Institute of Technology, Tokyo, Japan
Venue:
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
Year:
2006

Citing 7
Cited 8

A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
MagPIe: MPI's collective communication operations for clustered wide area systems

Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming
MPICH-G2: a Grid-enabled implementation of the Message Passing Interface

Journal of Parallel and Distributed Computing - Special issue on computational grids
Xen and the art of virtualization

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
NIST Net: a Linux-based network emulation tool

ACM SIGCOMM Computer Communication Review
Virtual Clusters for Grid Communities

CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
Live migration of virtual machines

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2

Model-based resource selection for efficient virtual cluster deployment

VTDC '07 Proceedings of the 2nd international workshop on Virtualization technology in distributed computing
Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters

Proceedings of the 18th ACM international symposium on High performance distributed computing
Information service of virtual machine pool for grid computing

Euro-Par'07 Proceedings of the 2007 conference on Parallel processing
A cost-benefit analysis of using cloud computing to extend the capacity of clusters

Cluster Computing
Provide virtual machine information for grid computing

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Failure-aware resource provisioning for hybrid Cloud infrastructure

Journal of Parallel and Distributed Computing
Enhancing performance of failure-prone clusters by adaptive provisioning of cloud resources

The Journal of Supercomputing
A survey on techniques for improving the energy efficiency of large-scale distributed systems

ACM Computing Surveys (CSUR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although multi-site MPI execution has been criticized in the past as being ”impractical” due to limitations in network latency and bandwidth, we believe many of the obstacles can be overcome by various means for wider classes of applications than previously believed. One such technique is transparent dynamic migration of MPI, coupled with aggressively performance-oriented overlay networks, assuming availability of gigabits of bandwidth on future WANs. The problem, of course, is to investigate the exact implications to application performances given the arsenal of such techniques, but such work has been quite sparse. Our current work involves using Xen as the underlying virtual machine layer to implement such migration, along with performance-optimizing migration strategies—this particular paper deals with performance evaluations of MPI on Xen VMs including what are the possible performance hindrances, implications of migrations, as well as the effect of variations in latencies and bandwidth parameters as realized by the overlay network using a software network emulator.