Automated and on-demand provisioning of virtual machines for database applications

  • Authors:

  • Piyush Shivam;Azbayar Demberel;Pradeep Gunda;David Irwin;Laura Grit;Aydan Yumerefendi;Shivnath Babu;Jeff Chase

  • Affiliations:

  • Duke University, Durham, NC;Duke University, Durham, NC;Duke University, Durham, NC;Duke University, Durham, NC;Duke University, Durham, NC;Duke University, Durham, NC;Duke University, Durham, NC;Duke University, Durham, NC

  • Venue:
  • Proceedings of the 2007 ACM SIGMOD international conference on Management of data
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Utility computing delivers compute and storage resources to applications as an 'on-demand utility', much like electricity, from a distributed collection of computing resources. There is great interest in running database applications on utility resources (e.g., Oracle's Grid initiative) due to reduced infrastructure and management costs, higher resource utilization, and the ability to handle sudden load surges. Virtual Machine (VM) technology offers powerful mechanisms to manage a utility resource infrastructure. However, provisioning VMs for applications to meet system performance goals, e.g., to meet service level agreements (SLAs), is an open problem. We are building two systems at Duke - Shirako and NIMO - that collectively address this problem. Shirako is a toolkit for leasing VMs to an application from a utility resource infrastructure. NIMO learns application performance models using novel techniques based on active learning, and uses these models to guide VM provisioning in Shirako. We will demonstrate: (a) how NIMO learns performance models in an online and automatic fashion using active learning; and (b) how NIMO uses these models to do automated and on-demand provisioning of VMs in Shirako for two classes of database applications - multi-tier web services and computational science workflows.