A Solution to Resource Underutilization for Web Services Hosted in the Cloud

  • Authors:
  • Dmytro Dyachuk;Ralph Deters

  • Affiliations:
  • MADMUC lab, Department of Computer Science, University of Saskatchewan, Saskatoon, Canada S7N 5C9;MADMUC lab, Department of Computer Science, University of Saskatchewan, Saskatoon, Canada S7N 5C9

  • Venue:
  • OTM '09 Proceedings of the Confederated International Conferences, CoopIS, DOA, IS, and ODBASE 2009 on On the Move to Meaningful Internet Systems: Part I
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

At the moment the service market is experiencing a continuous growth, as services allow easy and quick enhancing of new and existing applications. However, hosting services according to a common on-premise model is not sufficient for dealing with erratic, spike-prone service loads. A new more promising approach is hosting services in the cloud (utility computing), which enables dynamic resource allocation. The last provides an opportunity to meet average response time requirements even in case of long-term fluctuating loads. Unfortunately, in the presence of short term fluctuations the resources utilization has to stay under 50% in order to achieve response time of the same order as job sizes. In this work we suggest to compensate the problem of underutilization caused by hosting low-latency services by means of allocating the remaining resources to time insensitive service requests. This solution uses load balancing combined with admission control and scheduling application server threads. The proposed approach is evaluated by means of experiments with the prototype conducted with Amazon's EC2. The experimental results show that the servers utilization can be increased without penalizing low-latency requests.