Deferred Assignment Scheduling in Cluster-Based Servers

  • Authors:

  • Victoria Ungureanu;Benjamin Melamed;Michael Katehakis;Phillip G. Bradford

  • Affiliations:

  • Department of MSIS, Rutgers University, Piscataway 08854;Department of MSIS, Rutgers University, Newark 07102;Department of Computer Science, The University of Alabama, Tuscaloosa 35487-0290;DIMACS Center, Piscataway 08854

  • Venue:
  • Cluster Computing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a new scheduling policy for cluster-based servers called DAS (Deferred Assignment Scheduling). The main idea in DAS is to defer scheduling as much as possible in order to make better use of the accumulated information on job sizes. In broad outline, DAS operates as follows: (1) incoming jobs are held by the dispatcher in a buffer; (2) the dispatcher monitors the number of jobs being processed by each server; (3) when the number of jobs at a server queue drops below a prescribed threshold, the dispatcher sends to it the shortest job in its buffer.To gauge the efficacy of DAS, the paper presents simulation studies, using various data traces. The studies collected response times and slowdowns for two cluster configurations under multi-threaded and multi-process back-end server architectures. The experimental results show that in both architectures, DAS outperforms the Round-Robin policy in all traffic regimes, and the JSQ (Join Shortest Queue) policy in medium and heavy traffic regimes.