Active messages: a mechanism for integrated communication and computation
ISCA '92 Proceedings of the 19th annual international symposium on Computer architecture
PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing
PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing
U-Net: a user-level network interface for parallel and distributed computing
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Scalable parallel application launch on Cplant™
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor
Proceedings of the General Track: 2002 USENIX Annual Technical Conference
High performance RDMA-based MPI implementation over InfiniBand
ICS '03 Proceedings of the 17th annual international conference on Supercomputing
Xenoservers: Accountable Execution of Untrusted Programs
HOTOS '99 Proceedings of the The Seventh Workshop on Hot Topics in Operating Systems
A Case For Grid Computing On Virtual Machines
ICDCS '03 Proceedings of the 23rd International Conference on Distributed Computing Systems
User-Centric Performance Analysis of Market-Based Cluster Batch Schedulers
CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Xen and the art of virtualization
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Memory resource management in VMware ESX server
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Diagnosing performance overheads in the xen virtual machine environment
Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments
Design and Evaluation of an HPVM-Based Windows NT Supercomputer
International Journal of High Performance Computing Applications
High performance VMM-bypass I/O in virtual machines
ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
Fast and scalable startup of MPI programs in infiniband clusters
HiPC'04 Proceedings of the 11th international conference on High Performance Computing
System management software for virtual environments
Proceedings of the 4th international conference on Computing frontiers
Nomad: migrating OS-bypass networks in virtual machines
Proceedings of the 3rd international conference on Virtual execution environments
Transparent network services via a virtual traffic layer for virtual machines
Proceedings of the 16th international symposium on High performance distributed computing
Proactive fault tolerance for HPC with Xen virtualization
Proceedings of the 21st annual international conference on Supercomputing
Inter-domain socket communications supporting high performance and full binary compatibility on Xen
Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Virtual machine aware communication libraries for high performance computing
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Power-aware dynamic placement of HPC applications
Proceedings of the 22nd annual international conference on Supercomputing
Secure Sharing of an ICT Infrastructure through Vinci
AIMS '08 Proceedings of the 2nd international conference on Autonomous Infrastructure, Management and Security: Resilient Networks and Services
Performance implications of virtualizing multicore cluster machines
Proceedings of the 2nd workshop on System-level virtualization for high performance computing
Proceedings of the 2nd workshop on System-level virtualization for high performance computing
Proceedings of the 2nd workshop on System-level virtualization for high performance computing
Design of a real time transaction processing monitor (TPM) benchmark testbed
WSEAS Transactions on Information Science and Applications
IBMon: monitoring VMM-bypass capable InfiniBand devices using memory introspection
Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
An Analysis of HPC Benchmarks in Virtual Machine Environments
Euro-Par 2008 Workshops - Parallel Processing
CLOUDLET: towards mapreduce implementation on virtual machines
Proceedings of the 18th ACM international symposium on High performance distributed computing
Experimental study of large-scale computing on virtualized resources
VTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing
Transaction processing monitor (TPM) real-time benchmark testbed
ECC'08 Proceedings of the 2nd conference on European computing conference
The Eucalyptus Open-Source Cloud-Computing System
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
HPVZ: A High Performance Virtual Computing Environment for Super Computers
APPT '09 Proceedings of the 8th International Symposium on Advanced Parallel Processing Technologies
Live migration of direct-access devices
ACM SIGOPS Operating Systems Review
Evaluating MapReduce on Virtual Machines: The Hadoop Case
CloudCom '09 Proceedings of the 1st International Conference on Cloud Computing
Journal of Parallel and Distributed Computing
Task-aware based co-scheduling for virtual machine system
Proceedings of the 2010 ACM Symposium on Applied Computing
FaReS: Fair Resource Scheduling for VMM-Bypass InfiniBand Devices
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Elastic Site: Using Clouds to Elastically Extend Site Resources
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
International Journal of Advanced Media and Communication
Towards power efficient consolidation and distribution of virtual machines
Proceedings of the 48th Annual Southeast Regional Conference
A Xen-based paravirtualization system toward efficient high performance computing environments
MTPP'10 Proceedings of the Second Russia-Taiwan conference on Methods and tools of parallel programming multicomputers
Minimal-overhead virtualization of a large scale supercomputer
Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Experiences using cloud computing for a scientific workflow application
Proceedings of the 2nd international workshop on Scientific cloud computing
Performance of SAP ERP with memory virtualization using IBM active memory expansion as an example
Proceedings of the 5th international workshop on Virtualization technologies in distributed computing
Computer Science - Research and Development
VSim: a virtual simulation framework for high performance simulation
Proceedings of the 2010 Conference on Grand Challenges in Modeling & Simulation
The effect of multi-core on HPC applications in virtualized systems
Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
State of the Practice Reports
vPF_RING: towards wire-speed network monitoring using virtual machines
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Performance enhancement of SMP clusters with multiple network interfaces using virtualization
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
Xen-OSCAR for cluster virtualization
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
Performance combinative evaluation of typical virtual machine monitors
HPCA'09 Proceedings of the Second international conference on High Performance Computing and Applications
A virtualized HPC cluster computing environment on xen with web-based user interface
HPCA'09 Proceedings of the Second international conference on High Performance Computing and Applications
Energy-aware service allocation
Future Generation Computer Systems
CompSC: live migration with pass-through devices
VEE '12 Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments
Virtual InfiniBand clusters for HPC clouds
Proceedings of the 2nd International Workshop on Cloud Computing Platforms
HPC in Java: experiences in implementing the NAS parallel benchmarks
AIC'10/BEBI'10 Proceedings of the 10th WSEAS international conference on applied informatics and communications, and 3rd WSEAS international conference on Biomedical electronics and biomedical informatics
HPC performance domains on multi-core processors with virtualization
ARCS'12 Proceedings of the 25th international conference on Architecture of Computing Systems
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2
Journal of Grid Computing
Evaluation of the HPC challenge benchmarks in virtualized environments
Euro-Par'11 Proceedings of the 2011 international conference on Parallel Processing - Volume 2
On-line scheduling of multi-core processor tasks with virtualization
Operations Research Letters
Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date
Performance evaluation of video-on-demand in virtualized environments: the client perspective
Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date
VNET/P: bridging the cloud and high performance computing through fast overlay networking
Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
ACM SIGOPS Operating Systems Review
VC-Migration: Live Migration of Virtual Clusters in the Cloud
GRID '12 Proceedings of the 2012 ACM/IEEE 13th International Conference on Grid Computing
Evaluating hardware-assisted virtualization for deploying HPC-as-a-service
Proceedings of the 7th international workshop on Virtualization technologies in distributed computing
High performance cloud computing
Future Generation Computer Systems
Development of a virtualized supercomputing environment for genomic analysis
The Journal of Supercomputing
Analysis of I/O Performance on an Amazon EC2 Cluster Compute and High I/O Platform
Journal of Grid Computing
Evaluation of messaging middleware for high-performance cloud computing
Personal and Ubiquitous Computing
UCC '13 Proceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing
UCC '13 Proceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing
Hi-index | 0.00 |
Virtual machine (VM) technologies are experiencing a resurgence in both industry and research communities. VMs offer many desirable features such as security, ease of management, OS customization, performance isolation, check-pointing, and migration, which can be very beneficial to the performance and the manageability of high performance computing (HPC) applications. However, very few HPC applications are currently running in a virtualized environment due to the performance overhead of virtualization. Further, using VMs for HPC also introduces additional challenges such as management and distribution of OS images.In this paper we present a case for HPC with virtual machines by introducing a framework which addresses the performance and management overhead associated with VM-based computing. Two key ideas in our design are: Virtual Machine Monitor (VMM) bypass I/O and scalable VM image management. VMM-bypass I/O achieves high communication performance for VMs by exploiting the OS-bypass feature of modern high speed interconnects such as Infini-Band. Scalable VM image management significantly reduces the overhead of distributing and managing VMs in large scale clusters. Our current implementation is based on the Xen VM environment and InfiniBand. However, many of our ideas are readily applicable to other VM environments and high speed interconnects.We carry out detailed analysis on the performance and management overhead of our VM-based HPC framework. Our evaluation shows that HPC applications can achieve almost the same performance as those running in a native, non-virtualized environment. Therefore, our approach holds promise to bring the benefits of VMs to HPC applications with very little degradation in performance.