Self-Adjusting Scheduling of Master-Worker Applications on Distributed Clusters

  • Authors:
  • Elisa Heymann;Miquel A. Senar;Emilio Luque;Miron Livny

  • Affiliations:
  • -;-;-;-

  • Venue:
  • Euro-Par '01 Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

Strategies for scheduling parallel applications on a distributed system must trade-off processor application speed-up and resource efficiency. Most existing strategies focus mainly on achieving high application speed-up without taking into account the efficiency factor. This paper presents our experiences with a self-adaptive scheduling strategy that dynamically adjusts the number of resources used by an application based on performance measures gathered during its execution. The strategy seeks to maximize resource efficiency while minimizing the impact in loss of speedup. It also uses the measured times to decide how to assign tasks to resources. This work has been carried out in the context of opportunistic clusters of machines and we report the results achieved by our strategy when it was applied to an image thinning application run on a Condor pool.