A load balancing algorithm in multi-tenancy environment

  • Authors:
  • Tao Zhao;Hailong Sun;Yu Tang;Xudong Liu

  • Affiliations:
  • Beihang University;Beihang University;Beihang University;Beihang University

  • Venue:
  • Proceedings Demo & Poster Track of ACM/IFIP/USENIX International Middleware Conference
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multi-tenancy brings new challenges to load balancing, since it incurs resource competition and different QoS requirements of hosted applications. Therefore, servers with multiple deployed applications need a proper request scheduling policy to guarantee their quality of service, e.g., response time. However, when under heavy loads, mean response time of some applications may become too high to be acceptable due to the mutual intervention among tenants. In this work, we propose a new load balancing algorithm, "Server Throughput Restriction(STR)", based on M/G/s/s+r queueing model, in order to guarantee each application's mean response time.