The LC Assignment Policy for Cluster-Based Servers

  • Authors:
  • Victoria Ungureanu;Benjamin Melamed;Michael Katehakis

  • Affiliations:
  • Rutgers University, Newark, NJ;Rutgers University, Piscataway, NJ;Rutgers University, Newark, NJ

  • Venue:
  • NCA '04 Proceedings of the Network Computing and Applications, Third IEEE International Symposium
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

A cluster-based server consists of a front-end dispatcher and multiple back-end servers. The dispatcher receives incoming jobs, and then decides how to assign them to back-end servers, which in turn serve the jobs according to some discipline. Cluster-based servers have been broadly deployed as they combine good performance with low cost. Several assignment policies have been proposed for cluster-based servers, most of which aim to balance the load among back-end servers. There are two main strategies for load balancing: The first strategy aims at balancing the amount of work at back-end servers, while the second strategy aims at balancing the number of jobs assigned to back-end servers. Example of policies using these strategies are JSQ (Join Shortest Queue) and LC (Least Connected), respectively. In this paper we propose a policy, called LC, which combines the two aforementioned strategies. The paper shows experimentally that when preemption is admitted (i.e. jobs are executed concurrently by back-end servers), LC substantially outperforms both JSQ and LC. This improved performance is achieved by using only information readily available to the dispatcher, and therefore LC is a practical policy in regards to implementation.