On Job Scheduling for HPC-Clusters and the dynP Scheduler

  • Authors:
  • Achim Streit

  • Affiliations:
  • -

  • Venue:
  • HiPC '01 Proceedings of the 8th International Conference on High Performance Computing
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

Efficient job-scheduling strategies are important to improve the performance and usability of HPC-clusters. In this paper we evaluate job-scheduling strategies (FCFS, SJF, and LJF) used in the resource management system CCS (Computing Center Software). As input for our simulations we use two job sets that are generated from trace files of CCS.Based on the evaluation we introduce the dynP scheduler which combines the three scheduling strategies and dynamically changes between them online. The average estimated runtime of jobs in the waiting queue and two bounds are used as the criterion whether or not dynP switches to a new policy. Obviously the performance of dynP depends on the setting of the two bounds. Diverse parameter pairs were evaluated, and with the proper setting dynP achieves an equal or even better (+9%) performance.