Are user runtime estimates inherently inaccurate?

  • Authors:

  • Cynthia Bailey Lee;Yael Schwartzman;Jennifer Hardy;Allan Snavely

  • Affiliations:

  • ,San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;,San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA

  • Venue:
  • JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Computer system batch schedulers typically require information from the user upon job submission, including a runtime estimate. Inaccuracy of these runtime estimates, relative to the actual runtime of the job, has been well documented and is a perennial problem mentioned in the job scheduling literature. Typically users provide these estimates under circumstances where their job will be killed after the provided amount of time elapses. Also, users may be unaware of the potential benefits of providing accurate estimates, such as increased likelihood of backfilling. This study examines user behavior when the threat of job killing is removed, and when a tangible reward for accuracy is provided. We show that under these conditions, about half of users provide an improved estimate, but there is not a substantial improvement in the overall average accuracy.