Virtual InfiniBand clusters for HPC clouds

Authors:
Marius Hillenbrand;Viktor Mauch;Jan Stoess;Konrad Miller;Frank Bellosa
Affiliations:
System Architecture Group, KIT, Germany;Steinbuch Centre for Computing, KIT, Germany;System Architecture Group, KIT, Germany;System Architecture Group, KIT, Germany;System Architecture Group, KIT, Germany
Venue:
Proceedings of the 2nd International Workshop on Cloud Computing Platforms
Year:
2012

Citing 15
Cited 1

Effective distributed scheduling of parallel workloads

Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
SKaMPI: A Detailed, Accurate MPI Benchmark

Proceedings of the 5th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
A Case For Grid Computing On Virtual Machines

ICDCS '03 Proceedings of the 23rd International Conference on Distributed Computing Systems
Improving the Scalability of Parallel Jobs by adding Parallel Awareness to the Operating System

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8,192 Processors of ASCI Q

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
The Architecture of Virtual Machines

Computer
Virtualization for high-performance computing

ACM SIGOPS Operating Systems Review
Virtual Clusters for Grid Communities

CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
A case for high performance computing with virtual machines

Proceedings of the 20th annual international conference on Supercomputing
High performance VMM-bypass I/O in virtual machines

ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
A Formal Model to Manage the InfiniBand Arbitration Tables Providing QoS

IEEE Transactions on Computers
Characterizing application sensitivity to OS interference using kernel-level noise injection

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Contextualization: Providing One-Click Virtual Clusters

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Recommendations for Virtualization Technologies in High Performance Computing

CLOUDCOM '10 Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science
Cost-Effective HPC: The Community or the Cloud?

CLOUDCOM '10 Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science

Evaluating hardware-assisted virtualization for deploying HPC-as-a-service

Proceedings of the 7th international workshop on Virtualization technologies in distributed computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

High Performance Computing (HPC) employs fast interconnect technologies to provide low communication and synchronization latencies for tightly coupled parallel compute jobs. Contemporary HPC clusters have a fixed capacity and static runtime environments; they cannot elastically adapt to dynamic workloads, and provide a limited selection of applications, libraries, and system software. In contrast, a cloud model for HPC clusters promises more flexibility, as it provides elastic virtual clusters to be available on-demand. This is not possible with physically owned clusters. In this paper, we present an approach that makes it possible to use InfiniBand clusters for HPC cloud computing. We propose a performance-driven design of an HPC IaaS layer for InfiniBand, which provides throughput and latency-aware virtualization of nodes, networks, and network topologies, as well as an approach to an HPC-aware, multi-tenant cloud management system for elastic virtualized HPC compute clusters.