Fine-Grained Workflow in Heterogeneous Environments

  • Authors:
  • Oisin Curran;Paddy Downes;John Cunniffe;Andy Shearer

  • Affiliations:
  • -;-;-;-

  • Venue:
  • PDP '08 Proceedings of the 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008)
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work details the design and analysis of a fully decentralised scientific workflow management system for the execution of real applications in heterogeneous and unpredictable computing environments. Our model is based on a novel approach to the overlay metacomputer concept, founded on a graph-oriented peer-to-peer task distribution framework. This platform provides a basis for the development of a distributed virtual machine that can be dynamically deployed over a heterogeneous resource collection to provide a useful layer of abstraction, harnessing remote independent resources and making them appear dedicated to the execution of a particular collection of tasks. This paper demonstrates the utility of our model using synthetic and real workflow applications executed in a real and heterogeneous environment, identifying the potential benefit offine-grained workflow expressions as a method for achieving predictable task execution behaviour in unpredictable environments.