MARS: A Metascheduler for Distributed Resources in Campus Grids

  • Authors:
  • Abhijit Bose;Brian Wickman;Cameron Wood

  • Affiliations:
  • The University of Michigan, Ann Arbor;The University of Michigan, Ann Arbor;The University of Michigan, Ann Arbor

  • Venue:
  • GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Computational grids are increasingly being deployed in campus environments to provideunified access to distributed and heterogeneous resources such as clusters, storage arrays, networks, and scientific instruments. While the existing grid computing frameworks and protocols provide a robust set of mechanisms for user authentication, security, workflow and resource management; efficient scheduling of tasks on distributed and heterogeneous resources, termed as metascheduling, is an active area of research. In this paper, we describe MARS, an open-source metascheduling framework that can be integrated into existingcampus infrastructure to provide robust task scheduling and resource management capabilities. MARS uses a forecasting algorithm to predict resource-level scheduling parameters such as queue lengths, turn-around times, and resource utilization. These predicted values are then used to schedule tasks based on their priority levels. It allows preemption of lower-priority running tasks in favor of on-demand tasks. We have implemented heuristic and evolutionary scheduling algorithms in the present framework and evaluated it in a production environment consisting of several large Linux clusters. Our simulation results using actual workload traces from these clusters demonstrate the effectiveness of the current metascheduling framework.