Toward a doctrine of containment: grid hosting with adaptive resource control

Authors:
Lavanya Ramakrishnan;David Irwin;Laura Grit;Aydan Yumerefendi;Adriana Iamnitchi;Jeff Chase
Affiliations:
Renaissance Computing Institute;Duke University;Duke University;Duke University;University of South Florida;Duke University
Venue:
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Year:
2006

Citing 24
Cited 20

Advance reservations for predictive service in the Internet

Multimedia Systems - Special issue on the fifth workshop on network and operating system support for digital audio and video 1995 (NOSSDAV)
SNAP: A Protocol for Negotiating Service Level Agreements and Coordinating Resource Management in Distributed Systems

JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
Dynamic Virtual Clusters in a Grid Site Manager

HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
SODA: A Service-On-Demand Architecture for Application Service Hosting Utility Platforms

HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
A Case For Grid Computing On Virtual Machines

ICDCS '03 Proceedings of the 23rd International Conference on Distributed Computing Systems
A Community Authorization Service for Group Collaboration

POLICY '02 Proceedings of the 3rd International Workshop on Policies for Distributed Systems and Networks (POLICY'02)
SHARP: an architecture for secure resource peering

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Xen and the art of virtualization

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
The OptIPuter

Communications of the ACM - Blueprint for the future of high-performance networking
SoftUDC: A Software-Based Data Center for Utility Computing

Computer
From Sandbox to Playground: Dynamic Virtual Environments in the Grid

GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
Globus and PlanetLab Resource Management Solutions Compared

HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Optimizing the migration of virtual computers

OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Real-Time Performance Monitoring, Adaptive Control, and Interactive Steering of Computational Grids

International Journal of High Performance Computing Applications
Distributed virtual computers (DVC): simplifying the development of high performance Grid applications

CCGRID '04 Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid
Virtual Clusters for Grid Communities

CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
New grid scheduling and rescheduling methods in the GrADS project

International Journal of Parallel Programming - Special issue: The next generation software program
Efficient resource description and high quality selection for virtual grids

CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid - Volume 01
Task scheduling strategies for workflow-based applications in grids

CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2 - Volume 02
Towards virtual networks for virtual machine grid computing

VM'04 Proceedings of the 3rd conference on Virtual Machine Research And Technology Symposium - Volume 3
Sharing networked resources with brokered leases

ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
Globus toolkit version 4: software for service-oriented systems

NPC'05 Proceedings of the 2005 IFIP international conference on Network and Parallel Computing
GRUBER: a grid resource usage SLA broker

Euro-Par'05 Proceedings of the 11th international Euro-Par conference on Parallel Processing

Automated and on-demand provisioning of virtual machines for database applications

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Virtual Machine Hosting for Networked Clusters: Building the Foundations for "Autonomic" Orchestration

VTDC '06 Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing
Falkon: a Fast and Light-weight tasK executiON framework

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Realization of Dynamically Adaptive Weather Analysis and Forecasting in LEAD: Four Years Down the Road

ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
Performance analysis of allocation policies for interGrid resource provisioning

Information and Software Technology
Creating private network overlays for high performance scientific computing

Proceedings of the ACM/IFIP/USENIX 2007 International Conference on Middleware
A general service oriented approach for managing virtual machines allocation

Proceedings of the 2009 ACM symposium on Applied Computing
Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters

Proceedings of the 18th ACM international symposium on High performance distributed computing
VGrADS: enabling e-Science workflows on grids and clouds with fault tolerance

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
A reputation-driven scheduler for autonomic and sustainable resource sharing in Grid computing

Journal of Parallel and Distributed Computing
Creating private network overlays for high performance scientific computing

MIDDLEWARE2007 Proceedings of the 8th ACM/IFIP/USENIX international conference on Middleware
SOA based control plane for virtual clusters

Euro-Par'07 Proceedings of the 2007 conference on Parallel processing
Self-provisioned hybrid clouds

Proceedings of the 7th international conference on Autonomic computing
Virtual Organization Clusters: Self-provisioned clouds on the grid

Future Generation Computer Systems
Resource allocation algorithms for virtualized service hosting platforms

Journal of Parallel and Distributed Computing
A cost-benefit analysis of using cloud computing to extend the capacity of clusters

Cluster Computing
WORKEM: Representing and Emulating Distributed Scientific Workflow Execution State

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Case study of scientific data processing on a cloud using hadoop

HPCS'09 Proceedings of the 23rd international conference on High Performance Computing Systems and Applications
TopCluster: A hybrid cluster model to support dynamic deployment in Grid

Journal of Computer and System Sciences
Evaluating I/O aware network management for scientific workflows on networked clouds

NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management

Quantified Score

Hi-index	0.00

Visualization

Abstract

Grid computing environments need secure resource control and predictable service quality in order to be sustainable. We propose a grid hosting model in which independent, self-contained grid deployments run within isolated containers on shared resource provider sites. Sites and hosted grids interact via an underlying resource control plane to manage a dynamic binding of computational resources to containers. We present a prototype grid hosting system, in which a set of independent Globus grids share a network of cluster sites. Each grid instance runs a coordinator that leases and configures cluster resources for its grid on demand. Experiments demonstrate adaptive provisioning of cluster resources and contrast job-level and container-level resource management in the context of two grid application managers.