SHARP: an architecture for secure resource peering
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Dynamic Allocation of Servers to Jobs in a Grid Hosting Environment
BT Technology Journal
From Sandbox to Playground: Dynamic Virtual Environments in the Grid
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
Dynamic Allocation of Servers in a Grid Hosting Environment
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
Tunable randomization for load management in shared-disk clusters
ACM Transactions on Storage (TOS)
VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Cataclysm: policing extreme overloads in internet applications
WWW '05 Proceedings of the 14th international conference on World Wide Web
Identity Boxing: A New Technique for Consistent Global Identity
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A taxonomy of market-based resource management systems for utility-driven cluster computing
Software—Practice & Experience
Toward a doctrine of containment: grid hosting with adaptive resource control
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Virtual workspaces: Achieving quality of service and quality of life in the Grid
Scientific Programming - Dynamic Grids and Worldwide Computing
Explicit control a batch-aware distributed file system
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
Optimizing grid site manager performance with virtual machines
WORLDS'06 Proceedings of the 3rd conference on USENIX Workshop on Real, Large Distributed Systems - Volume 3
VTDC '06 Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing
A case for cooperative and incentive-based federation of distributed clusters
Future Generation Computer Systems
Agile dynamic provisioning of multi-tier Internet applications
ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Usher: an extensible framework for managing custers of virtual machines
LISA'07 Proceedings of the 21st conference on Large Installation System Administration Conference
Building of computational grid around virtual enterprises
AIC'05 Proceedings of the 5th WSEAS International Conference on Applied Informatics and Communications
Cataclysm: Scalable overload policing for internet applications
Journal of Network and Computer Applications
Flying Low: Simple Leases with Workspace Pilot
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Performance implications of virtualizing multicore cluster machines
Proceedings of the 2nd workshop on System-level virtualization for high performance computing
Resource overbooking and application profiling in a shared Internet hosting platform
ACM Transactions on Internet Technology (TOIT)
Creating private network overlays for high performance scientific computing
Proceedings of the ACM/IFIP/USENIX 2007 International Conference on Middleware
SnowFlock: rapid virtual machine cloning for cloud computing
Proceedings of the 4th ACM European conference on Computer systems
Adding the easy button to the cloud with SnowFlock and MPI
Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Efficient application placement in a dynamic hosting platform
Proceedings of the 18th international conference on World wide web
A progressive multi-layer resource reconfiguration framework for time-shared grid systems
Future Generation Computer Systems
Dynamic Provisioning of Virtual Clusters for Grid Computing
Euro-Par 2008 Workshops - Parallel Processing
Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters
Proceedings of the 18th ACM international symposium on High performance distributed computing
An architecture for virtual solution composition and deployment in infrastructure clouds
VTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing
Toward dependency-aware live virtual machine migration
VTDC '09 Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing
The Eucalyptus Open-Source Cloud-Computing System
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Dynamic Provisioning of Virtual Organization Clusters
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Using heuristics to improve service portfolio selection in P2P grids
IM'09 Proceedings of the 11th IFIP/IEEE international conference on Symposium on Integrated Network Management
Applying a Stochastic Model to a Dynamic, QoS Enabled Web Services Hosting Environment
Electronic Notes in Theoretical Computer Science (ENTCS)
Resource management system for computational grid building
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Architecture-based autonomic deployment of J2EE systems in grids
GPC'07 Proceedings of the 2nd international conference on Advances in grid and pervasive computing
HiPC'07 Proceedings of the 14th international conference on High performance computing
Creating private network overlays for high performance scientific computing
MIDDLEWARE2007 Proceedings of the 8th ACM/IFIP/USENIX international conference on Middleware
ADVE: adaptive and dependable virtual environments for grid computing
GPC'08 Proceedings of the 3rd international conference on Advances in grid and pervasive computing
Grid virtual laboratory architecture
Euro-Par'07 Proceedings of the 2007 conference on Parallel processing
Euro-Par'07 Proceedings of the 2007 conference on Parallel processing
Self-provisioned hybrid clouds
Proceedings of the 7th international conference on Autonomic computing
Virtual Organization Clusters: Self-provisioned clouds on the grid
Future Generation Computer Systems
Suspending, migrating and resuming HPC virtual clusters
Future Generation Computer Systems
Cluster-wide context switch of virtualized jobs
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Data Sharing Options for Scientific Workflows on Amazon EC2
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Tide: achieving self-scaling in virtualized datacenter management middleware
Proceedings of the 11th International Middleware Conference Industrial track
Virtual playgrounds: managing virtual resources in the grid
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Provide virtual machine information for grid computing
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
SnowFlock: Virtual Machine Cloning as a First-Class Cloud Primitive
ACM Transactions on Computer Systems (TOCS)
On the use of clouds for grid resource provisioning
Future Generation Computer Systems
Hybrid Computing-Where HPC meets grid and Cloud Computing
Future Generation Computer Systems
Approaches towards dealing with complex systems configuration
OTM'10 Proceedings of the 2010 international conference on On the move to meaningful internet systems
Jump-start cloud: efficient deployment framework for large-scale cloud applications
ICDCIT'11 Proceedings of the 7th international conference on Distributed computing and internet technology
Belle-DIRAC Setup for Using Amazon Elastic Compute Cloud
Journal of Grid Computing
An elasticity model for High Throughput Computing clusters
Journal of Parallel and Distributed Computing
Experiences using cloud computing for a scientific workflow application
Proceedings of the 2nd international workshop on Scientific cloud computing
Shadowfax: scaling in heterogeneous cluster systems via GPGPU assemblies
Proceedings of the 5th international workshop on Virtualization technologies in distributed computing
Wrangler: virtual cluster provisioning for the cloud
Proceedings of the 20th international symposium on High performance distributed computing
State of the Practice Reports
Auto-scaling to minimize cost and meet application deadlines in cloud workflows
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Secure mobile agent deployment and communication towards autonomous semantic grid
WRAC'05 Proceedings of the Second international conference on Radical Agent Concepts: innovative Concepts for Autonomic and Agent-Based Systems
QoS and preemption aware scheduling in federated and virtualized Grid computing environments
Journal of Parallel and Distributed Computing
On scalability and mobility management of hierarchical large-scale ad hoc networks
EUC'05 Proceedings of the 2005 international conference on Embedded and Ubiquitous Computing
Private virtual cluster: infrastructure and protocol for instant grids
Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Virtual workspaces in the grid
Euro-Par'05 Proceedings of the 11th international Euro-Par conference on Parallel Processing
Research and design of deployment framework for blade-based data center
ICA3PP'10 Proceedings of the 10th international conference on Algorithms and Architectures for Parallel Processing - Volume Part I
Distributed workload and response time management for web applications
Proceedings of the 7th International Conference on Network and Services Management
Online optimization for scheduling preemptable tasks on IaaS cloud systems
Journal of Parallel and Distributed Computing
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2
Journal of Grid Computing
Integration of Workflow Partitioning and Resource Provisioning
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Composable IO: a novel resource sharing platform in personal Clouds
The Journal of Supercomputing
The CloudGrid approach: Security analysis and performance evaluation
Future Generation Computer Systems
Jump-start cloud: efficient deployment framework for large-scale cloud applications
Concurrency and Computation: Practice & Experience
Improving scheduling performance using a q-learning-based leasing policy for clouds
Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
TopCluster: A hybrid cluster model to support dynamic deployment in Grid
Journal of Computer and System Sciences
Towards transparent and distributed workload management for large scale web servers
Future Generation Computer Systems
Resource provisioning based on lease preemption in InterGrid
ACSC '11 Proceedings of the Thirty-Fourth Australasian Computer Science Conference - Volume 113
Consolidated cluster systems for data centers in the cloud age: a survey and analysis
Frontiers of Computer Science: Selected Publications from Chinese Universities
Developing an optimized application hosting framework in Clouds
Journal of Computer and System Sciences
Evaluating I/O aware network management for scientific workflows on networked clouds
NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management
The Journal of Supercomputing
| Hi-index | 0.00 |
This paper presents new mechanisms for dynamic resource management in a cluster manager called Cluster-on-Demand (COD). COD allocates servers from a common pool to multiple virtual clusters (vclusters), with independently configured software environments, name spaces, user access controls, and network storage volumes. We present experiments using the popular Sun GridEngine batch scheduler to demonstrate that dynamic virtual clusters are an enabling abstraction for advanced resource management in computing utilities and grids. In particular, they support dynamic, policy-based cluster sharing between local users and hosted grid services, resource reservation and adaptive provisioning, scavenging of idle resources, and dynamic instantiation of grid services. These goals are achieved in a direct and general way through a new set of fundamental cluster management functions, with minimal impact on the grid middleware itself.