Combining batch execution and leasing using virtual machines
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Model-based resource selection for efficient virtual cluster deployment
VTDC '07 Proceedings of the 2nd international workshop on Virtualization technology in distributed computing
A multi-site virtual cluster system for wide area networks
LASCO'08 First USENIX Workshop on Large-Scale Computing
Flying Low: Simple Leases with Workspace Pilot
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Dynamic Provisioning of Virtual Organization Clusters
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
A Model-Based Algorithm for Optimizing I/O Intensive Applications in Clouds Using VM-Based Migration
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Model-based optimization for data-intensive application on virtual cluster
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Suspending, migrating and resuming HPC virtual clusters
Future Generation Computer Systems
Scalable repositories for virtual clusters
Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
SnowFlock: Virtual Machine Cloning as a First-Class Cloud Primitive
ACM Transactions on Computer Systems (TOCS)
On the use of clouds for grid resource provisioning
Future Generation Computer Systems
Minimal-overhead virtualization of a large scale supercomputer
Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Belle-DIRAC Setup for Using Amazon Elastic Compute Cloud
Journal of Grid Computing
Rapid application configuration in Amazon cloud using configurable virtual appliances
Proceedings of the 2011 ACM Symposium on Applied Computing
DEVA: distributed ensembles of virtual appliances in the cloud
Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
Towards autonomic management for Cloud services based upon volunteered resources
Concurrency and Computation: Practice & Experience
Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date
Toward scalable Web systems on multicore clusters: making use of virtual machines
The Journal of Supercomputing
Improving scheduling performance using a q-learning-based leasing policy for clouds
Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
TopCluster: A hybrid cluster model to support dynamic deployment in Grid
Journal of Computer and System Sciences
VMM detection using privilege rings and benchmark execution times
International Journal of Communication Networks and Distributed Systems
Hi-index | 0.00 |
One of the advantages in virtualized computing clusters compared to traditional shared HPC environments is their ability to accommodate user-specific system customization. However, past attempts to providing virtual clusters are not scalable with increasing number of VMs, nor do they allow fine-grained customization of VMs, assuming that preconfigured VM images are always available on the Grid. We propose a new virtual cluster installation technique that achieves efficiency and scalability, and yet simultaneously fine-grained customizability. It allows the user to create VMs on the fly for fine-grained customization of VMs, and pipelined data transfer for scalable installation with increasing number of VMs. To achieve efficiency in the presence of such full customization, it automatically caches frequently-constructed virtual disk images to save software installation time in common cases. Our experimental studies using a prototype implementation show that installation of a 190-node virtual cluster can be done in 40 seconds. From this result along with a scalability study, we estimate that installation of a 1000-node virtual cluster could be done in less than two minutes.