Fair, effective, efficient and differentiated scheduling in an enterprise data warehouse

  • Authors:
  • Chetan Gupta;Abhay Mehta;Song Wang;Umesh Dayal

  • Affiliations:
  • Hewlett-Packard Labs;Hewlett-Packard Labs;Hewlett-Packard Labs;Hewlett-Packard Labs

  • Venue:
  • Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

A typical online Business Intelligence (BI) workload consists of a combination of short, less intensive queries, along with long, resource intensive queries. As such, the longest queries in a typical BI workload may take several orders of magnitude more time to execute, compared with the shortest queries in the workload. This makes it challenging to design a good Mixed Workload Scheduler (MWS). In this paper we first define the design criteria that make a 'good' MWS. We then use these criteria to design rFEED, a MWS that is fair, effective, efficient, and differentiated. We simulate real workloads and compare our rFEED MWS with models of the current best of breed commercial systems. We show that the rFEED MWS works extremely well.