Flexible and Efficient Workflow Deployment of Data-Intensive Applications On Grids With MOTEUR

  • Authors:

  • Tristan Glatard;Johan Montagnat;Diane Lingrand;Xavier Pennec

  • Affiliations:

  • CNRS, I3S UNIT, RAINBOW TEAM, 930 ROUTE DES COLLES, BP 145 06903 SOPHIA ANTIPOLIS CEDEX, FRANCE;CNRS, I3S UNIT, RAINBOW TEAM, 930 ROUTE DES COLLES, BP 145 06903 SOPHIA ANTIPOLIS CEDEX, FRANCE;CNRS, I3S UNIT, RAINBOW TEAM, 930 ROUTE DES COLLES, BP 145 06903 SOPHIA ANTIPOLIS CEDEX, FRANCE;INRIA SOPHIA-ANTIPOLIS, ASCLEPIOS TEAM, 2004 ROUTE DES LUCIOLES BP 93 06902 SOPHIA ANTIPOLIS CEDEX, FRANCE

  • Venue:
  • International Journal of High Performance Computing Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Workflows offer a powerful way to describe and deploy applications on grid infrastructures. Many workflow management systems have been proposed but there is still a lack of a system that would allow both a simple description of the dataflow of the application and an efficient execution on a grid platform. In this paper, we study the requirements of such a system, underlining the need for well-defined data composition strategies on the one hand and for a fully parallel execution on the other. As combining those features is not straightforward, we then propose algorithms to do so and we describe the design and implementation of MOTEUR, a workflow engine that fulfills those requirements. Performance results and overhead quantification are shown to evaluate MOTEUR with respect to existing comparable workflow systems on a production grid.