Semicoarsening Multigrid on Distributed Memory Machines
SIAM Journal on Scientific Computing
A Case For Grid Computing On Virtual Machines
ICDCS '03 Proceedings of the 23rd International Conference on Distributed Computing Systems
MPICH-G2: a Grid-enabled implementation of the Message Passing Interface
Journal of Parallel and Distributed Computing - Special issue on computational grids
Xen and the art of virtualization
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
A network-failure-tolerant message-passing system for terascale clusters
International Journal of Parallel Programming
HyperSpector: virtual distributed monitoring environments for secure intrusion detection
Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments
Virtualization for high-performance computing
ACM SIGOPS Operating Systems Review
Design and Evaluation of Nemesis, a Scalable, Low-Latency, Message-Passing Communication Subsystem
CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
A case for high performance computing with virtual machines
Proceedings of the 20th annual international conference on Supercomputing
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
K42: building a complete operating system
Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006
Proper: privileged operations in a virtualised system environment
ATEC '05 Proceedings of the annual conference on USENIX Annual Technical Conference
Live migration of virtual machines
NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
Nomad: migrating OS-bypass networks in virtual machines
Proceedings of the 3rd international conference on Virtual execution environments
High performance VMM-bypass I/O in virtual machines
ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
Proactive fault tolerance for HPC with Xen virtualization
Proceedings of the 21st annual international conference on Supercomputing
Concurrent Direct Network Access for Virtual Machine Monitors
HPCA '07 Proceedings of the 2007 IEEE 13th International Symposium on High Performance Computer Architecture
XenLoop: a transparent high performance inter-vm network loopback
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Proceedings of the 2nd workshop on System-level virtualization for high performance computing
A high-efficient inter-domain data transferring system for virtual machines
Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication
An evaluation of multiple communication interfaces for virtualized SMP clusters
Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Efficient Shared Memory Message Passing for Inter-VM Communications
Euro-Par 2008 Workshops - Parallel Processing
A strategy for parallel sorting algorithms evaluation based on MPI technology
AIKED'09 Proceedings of the 8th WSEAS international conference on Artificial intelligence, knowledge engineering and data bases
The Eucalyptus Open-Source Cloud-Computing System
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
XenLoop: a transparent high performance inter-VM network loopback
Cluster Computing
Fido: fast inter-virtual-machine communication for enterprise appliances
USENIX'09 Proceedings of the 2009 conference on USENIX Annual technical conference
vSnoop: Improving TCP Throughput in Virtualized Environments via Acknowledgement Offload
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Live gang migration of virtual machines
Proceedings of the 20th international symposium on High performance distributed computing
The effect of multi-core on HPC applications in virtualized systems
Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Opportunistic flooding to improve TCP transmit performance in virtualized clouds
Proceedings of the 2nd ACM Symposium on Cloud Computing
idsocket: API for inter-domain communications base on xen
ICA3PP'10 Proceedings of the 10th international conference on Algorithms and Architectures for Parallel Processing - Volume Part I
A high performance Inter-VM network communication mechanism
ICA3PP'10 Proceedings of the 10th international conference on Algorithms and Architectures for Parallel Processing - Volume Part I
Facilitating inter-application interactions for OS-level virtualization
VEE '12 Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments
Inter-rack live migration of multiple virtual machines
Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date
vSlicer: latency-aware virtual machine scheduling via differentiated-frequency CPU slicing
Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
A high performance inter-domain communication approach for virtual machines
Journal of Systems and Software
VIDAS: object-based virtualized data sharing for high performance storage I/O
Proceedings of the 4th ACM workshop on Scientific cloud computing
TCNet: cross-node virtual machine communication acceleration
Proceedings of the ACM International Conference on Computing Frontiers
Protocol Responsibility Offloading to Improve TCP Throughput in Virtualized Environments
ACM Transactions on Computer Systems (TOCS)
AdaptIDC: Adaptive inter-domain communication in virtualized environments
Computers and Electrical Engineering
pvFPGA: accessing an FPGA-based hardware accelerator in a paravirtualized environment
Proceedings of the Ninth IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis
Evaluation of messaging middleware for high-performance cloud computing
Personal and Ubiquitous Computing
Hi-index | 0.00 |
As the size and complexity of modern computing systems keep increasing to meet the demanding requirements of High Performance Computing (HPC) applications, manageability is becoming a critical concern to achieve both high performance and high productivity computing. Meanwhile, virtual machine (VM) technologies have become popular in both industry and academia due to various features designed to ease system management and administration. While a VM-based environment can greatly help manageability on large-scale computing systems, concerns over performance have largely blocked the HPC community from embracing VM technologies. In this paper, we follow three steps to demonstrate the ability to achieve near-native performance in a VM-based environment for HPC. First, we propose Inter-VM Communication (IVC), a VM-aware communication library to support efficient shared memory communication among computing processes on the same physical host, even though they may be in different VMs. This is critical for multi-core systems, especially when individual computing processes are hosted on different VMs to achieve fine-grained control. Second, we design a VM-aware MPI library based on MVAPICH2 (a popular MPI library), called MVAPICH2-ivc, which allows HPC MPI applications to transparently benefit from IVC. Finally, we evaluate MVAPICH2-ivc on clusters featuring multi-core systems and high performance InfiniBand interconnects. Our evaluation demonstrates that MVAPICH2-ivc can improve NAS Parallel Benchmark performance by up to 11% in VM-based environment on eight-core Intel Clover-town systems, where each compute process is in a separate VM. A detailed performance evaluation for up to 128 processes (64 node dual-socket single-core systems) shows only a marginal performance overhead of MVAPICH2-ivc as compared with MVAPICH2 running in a native environment. This study indicates that performance should no longer be a barrier preventing HPC environments from taking advantage of the various features available through VM technologies.