A multi-level scheduler for batch jobs on grids

  • Authors:
  • Marco Pasquali;Ranieri Baraglia;Gabriele Capannini;Laura Ricci;Domenico Laforenza

  • Affiliations:
  • Information Science and Technologies Institute, Italian National Research Council, Pisa, Italy;Information Science and Technologies Institute, Italian National Research Council, Pisa, Italy;Information Science and Technologies Institute, Italian National Research Council, Pisa, Italy;Department of Computer Science, University of Pisa, Pisa, Italy;Institute of Informatics and Telematics, Italian National Research Council, Pisa, Italy

  • Venue:
  • The Journal of Supercomputing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a two-level scheduler for dynamically scheduling a continuous stream of sequential and multi-threaded batch jobs on grids, made up of interconnected clusters of heterogeneous single-processor and/or symmetric multiprocessor machines. The scheduler aims to schedule arriving jobs respecting their computational and deadline requirements, and optimizing the hardware and software resource usage. At the top of the hierarchy a lightweight meta-scheduler (MS) classifies incoming jobs according to their requirements, and schedules them among the underlying resources balancing the workload. At cluster level a Flexible Backfilling algorithm carries out the job machine associations by exploiting dynamic information about the environment. Scheduling decisions at both levels are based on job priorities computed by using different sets of heuristics. The different proposals have been compared through simulations. Performance figures show the feasibility of our approach.