Paravirtualization for HPC systems

Authors:
Lamia Youseff;Rich Wolski;Brent Gorda;Chandra Krintz
Affiliations:
Department of Computer Science, University of California, Santa Barbara;Department of Computer Science, University of California, Santa Barbara;Lawrence Livermore National Lab (LLNL);Department of Computer Science, University of California, Santa Barbara
Venue:
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
Year:
2006

Citing 19
Cited 25

Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler

Proceedings of the seventeenth ACM symposium on Operating systems principles
Formal requirements for virtualizable third generation architectures

Communications of the ACM
Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor

Proceedings of the General Track: 2002 USENIX Annual Technical Conference
PDP-10 virtual machines

Proceedings of the workshop on virtual computer systems
Application and analysis of the virtual machine approach to information system security and isolation

Proceedings of the workshop on virtual computer systems
Sharing data and services in a virtual machine system

SOSP '75 Proceedings of the fifth ACM symposium on Operating systems principles
The PDP-11 virtual machine architecture: A case study

SOSP '75 Proceedings of the fifth ACM symposium on Operating systems principles
Internet Suspend/Resume

WMCSA '02 Proceedings of the Fourth IEEE Workshop on Mobile Computing Systems and Applications
Memory resource management in VMware ESX server

ACM SIGOPS Operating Systems Review - OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation
Xen and the art of virtualization

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Using Phase Behavior in Scientific Application to Guide Linux Operating System Customization

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 10 - Volume 11
Scale and performance in the Denali isolation kernel

OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Virtual Machine Monitors: Current Technology and Future Trends

Computer
Self-migration of operating systems

Proceedings of the 11th workshop on ACM SIGOPS European workshop
The HPC Challenge (HPCC) benchmark suite

Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Virtual Machines: Versatile Platforms for Systems and Processes (The Morgan Kaufmann Series in Computer Architecture and Design)

Virtual Machines: Versatile Platforms for Systems and Processes (The Morgan Kaufmann Series in Computer Architecture and Design)
Xen and the art of repeated research

ATEC '04 Proceedings of the annual conference on USENIX Annual Technical Conference
Live migration of virtual machines

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
A virtual machine time-sharing system

IBM Systems Journal

Evaluating the Performance Impact of Xen on MPI and Process Execution For HPC Systems

VTDC '06 Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing
The impact of paravirtualized memory hierarchy on linear algebra computational kernels and software

HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Feedback-controlled resource sharing for predictable eScience

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Performance implications of virtualizing multicore cluster machines

Proceedings of the 2nd workshop on System-level virtualization for high performance computing
Effects of virtualization on a scientific application running a hyperspectral radiative transfer code on virtual machines

Proceedings of the 2nd workshop on System-level virtualization for high performance computing
On the use of intelligent local resource management for improved virtualized resource provision: challenges, required features, and an approach

Proceedings of the 2nd workshop on System-level virtualization for high performance computing
An evaluation of multiple communication interfaces for virtualized SMP clusters

Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Performance comparison of two virtual machine scenarios using an HPC application: a case study using molecular dynamics simulations

Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Dynamic Resources Management of Virtual Appliances on a Computational Cluster

Euro-Par 2008 Workshops - Parallel Processing
An Analysis of HPC Benchmarks in Virtual Machine Environments

Euro-Par 2008 Workshops - Parallel Processing
Processing of medical images in virtual distributed environment

Proceedings of the 2009 Euro American Conference on Telematics and Information Systems: New Opportunities to increase Digital Citizenship
Paravirtualization effect on single- and multi-threaded memory-intensive linear algebra software

Cluster Computing
Scientific workflows and clouds

Crossroads - Plugging Into the Cloud
The impact of virtualisation on the performance and operational costs of Massively Multiplayer Online Games

International Journal of Advanced Media and Communication
Data Sharing Options for Scientific Workflows on Amazon EC2

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
An elasticity model for High Throughput Computing clusters

Journal of Parallel and Distributed Computing
Experiences using cloud computing for a scientific workflow application

Proceedings of the 2nd international workshop on Scientific cloud computing
Making time-stepped applications tick in the cloud

Proceedings of the 2nd ACM Symposium on Cloud Computing
vPF_RING: towards wire-speed network monitoring using virtual machines

Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Performance evaluation of MapReduce using full virtualisation on a departmental cloud

International Journal of Applied Mathematics and Computer Science - SPECIAL SECTION: Efficient Resource Management for Grid-Enabled Applications
Adaptive resource remapping through live migration of virtual machines

ICA3PP'11 Proceedings of the 11th international conference on Algorithms and architectures for parallel processing - Volume Part I
HPC performance domains on multi-core processors with virtualization

ARCS'12 Proceedings of the 25th international conference on Architecture of Computing Systems
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2

Journal of Grid Computing
Evaluation of the HPC challenge benchmarks in virtualized environments

Euro-Par'11 Proceedings of the 2011 international conference on Parallel Processing - Volume 2
Analysis of I/O Performance on an Amazon EC2 Cluster Compute and High I/O Platform

Journal of Grid Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this work, we investigate the efficacy of using paravirtualizing software for performance-critical HPC kernels and applications. We present a comprehensive performance evaluation of Xen, a low-overhead, Linux-based, virtual machine monitor, for paravirtualization of HPC cluster systems at LLNL. We investigate subsystem and overall performance using a wide range of benchmarks and applications. We employ statistically sound methods to compare the performance of a paravirtualized kernel against three Linux operating systems: RedHat Enterprise 4 for build versions 2.6.9 and 2.6.12 and the LLNL CHAOS kernel. Our results indicate that Xen is very efficient and practical for HPC systems.