Using historical accounting information to predict the resource usage of grid jobs

  • Authors:
  • Rosario M. Piro;Andrea Guarise;Giuseppe Patania;Albert Werbrouck

  • Affiliations:
  • Molecular Biotechnology Center (MBC), Department of Genetics, Biology and Biochemistry, University of Torino, Via Nizza 52, 10126 Torino, Italy;Istituto Nazionale di Fisica Nucleare (INFN) - Sezione di Torino, Via Pietro Giuria 1, 10125 Torino, Italy;Istituto Nazionale di Fisica Nucleare (INFN) - Sezione di Torino, Via Pietro Giuria 1, 10125 Torino, Italy;Istituto Nazionale di Fisica Nucleare (INFN) - Sezione di Torino, Via Pietro Giuria 1, 10125 Torino, Italy

  • Venue:
  • Future Generation Computer Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Basing job scheduling decisions on estimated queue wait times may help in efficiently balancing the workload on the grid. Previous work on usage prediction has mainly described methods for the estimation of queue wait times on clusters and supercomputers, based on the prediction of the run times of single jobs in a queue. We evaluate the possibility to use the historical information provided by a grid accounting system to predict not only run times of grid jobs, but also other types of resource usage (or resource consumption), hence increasing the parameter space on which job scheduling decisions may be based. For this purpose we analyze three grid accounting datasets from a large-scale production environment and report interesting findings about their characteristics.