Optimized pre-copy live migration for memory intensive applications

Authors:
Khaled Z. Ibrahim;Steven Hofmeyr;Costin Iancu;Eric Roman
Affiliations:
Lawrence Berkeley National Laboratory, Berkeley;Lawrence Berkeley National Laboratory, Berkeley;Lawrence Berkeley National Laboratory, Berkeley;Lawrence Berkeley National Laboratory, Berkeley
Venue:
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Year:
2011

Citing 13
Cited 3

Optimizing the migration of virtual computers

ACM SIGOPS Operating Systems Review - OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation
Xen and the art of virtualization

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Live migration of virtual machines

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
Proactive fault tolerance for HPC with Xen virtualization

Proceedings of the 21st annual international conference on Supercomputing
Virtual Machine Hosting for Networked Clusters: Building the Foundations for "Autonomic" Orchestration

VTDC '06 Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing
A Framework for Proactive Fault Tolerance

ARES '08 Proceedings of the 2008 Third International Conference on Availability, Reliability and Security
Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning

Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
High performance virtual machine migration with RDMA over modern interconnects

CLUSTER '07 Proceedings of the 2007 IEEE International Conference on Cluster Computing
Virtual machine contracts for datacenter and cloud computing environments

ACDC '09 Proceedings of the 1st workshop on Automated control for datacenters and clouds
Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation

CloudCom '09 Proceedings of the 1st International Conference on Cloud Computing
Minimal-overhead virtualization of a large scale supercomputer

Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Characterizing the Performance of Parallel Applications on Multi-socket Virtual Machines

CCGRID '11 Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
Proactive fault tolerance in MPI applications via task migration

HiPC'06 Proceedings of the 13th international conference on High Performance Computing

A hybrid local storage transfer scheme for live migration of I/O intensive workloads

Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
AI-Ckpt: leveraging memory access patterns for adaptive asynchronous incremental checkpointing

Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
A survey of migration mechanisms of virtual machines

ACM Computing Surveys (CSUR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Live migration is a widely used technique for resource consolidation and fault tolerance. KVM and Xen use iterative pre-copy approaches which work well in practice for commercial applications. In this paper, we study pre-copy live migration of MPI and OpenMP scientific applications running on KVM and present a detailed performance analysis of the migration process. We show that due to a high rate of memory changes, the current KVM rate control and target downtime heuristics do not cope well with HPC applications: statically choosing rate limits and downtimes is infeasible and current mechanisms sometimes provide suboptimal performance. We present a novel on-line algorithm able to provide minimal downtime and minimal impact on end-to-end application performance. At the core of this algorithm is controlling migration based on the application memory rate of change.