Workflow as a service: an approach to workflow farming

Authors:
Reginald Cushing;Adam S.Z. Belloum;Vladimir Korkhov;Dmitry Vasyunin;Marian Bubak;Carole Leguy
Affiliations:
University of Amsterdam, Amsterdam, Netherlands;University of Amsterdam, Amsterdam, Netherlands;Academic Medical Center, Amsterdam, Netherlands;University of Amsterdam, Amsterdam, Netherlands;University of Amsterdam, Amsterdam, Netherlands;Eindhoven university of Technology, Eindhoven, Netherlands
Venue:
Proceedings of the 3rd international workshop on Emerging computational methods for the life sciences
Year:
2012

Citing 17
Cited 0

The Development of a Grid Based Engineering Design Problem Solving Environment

ICCS '02 Proceedings of the International Conference on Computational Science-Part I
A computational economy for grid computing and its implementation in the Nimrod-G resource broker

Future Generation Computer Systems - Grid computing: Towards a new computing infrastructure
Scheduling with Advanced Reservations

IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
BOINC: A System for Public-Resource Computing and Storage

GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
The AppLeS Parameter Sweep Template: User-level middleware for the Grid\m{1}

Scientific Programming
WS-VLAM: towards a scalable workflow system on the grid

Proceedings of the 2nd workshop on Workflows in support of large-scale science
VLAM-G: Interactive data driven workflow engine for Grid-enabled resources

Scientific Programming
Dynamic workload balancing of parallel applications with user-level scheduling on the Grid

Future Generation Computer Systems
The Open Provenance Model: An Overview

Provenance and Annotation of Data and Processes
Scientific Workflows as Services in caGrid: A Taverna and gRAVI Approach

ICWS '09 Proceedings of the 2009 IEEE International Conference on Web Services
Accelerating Parameter Sweep Workflows by Utilizing Ad-hoc Network Computing Resources: An Ecological Example

SERVICES '09 Proceedings of the 2009 Congress on Services - I
Three fundamental dimensions of scientific workflow interoperability: Model of computation, language, and execution environment

Future Generation Computer Systems
Techniques for generic probabilistic inversion

Computational Statistics & Data Analysis
Characterizing deep sequencing analytics using BFAST: towards a scalable distributed architecture for next-generation sequencing data

Proceedings of the second international workshop on Emerging computational methods for the life sciences
HisT/PLIER: A Two-Fold Provenance Approach for Grid-Enabled Scientific Workflows Using WS-VLAM

GRID '11 Proceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing
Prediction-based auto-scaling of scientific workflows

Proceedings of the 9th International Workshop on Middleware for Grids, Clouds and e-Science
Dynamic Handling for Cooperating Scientific Web Services

ESCIENCE '11 Proceedings of the 2011 IEEE Seventh International Conference on eScience

Quantified Score

Hi-index	0.00

Visualization

Abstract

Task farming is often used to enable parameter sweep for exploration of large sets of initial conditions for large scale complex simulations. Available solutions enable to perform parameter sweep by creating multiple grid job submissions with different parameters. This paper presents an approach to farm grid workflows with a web service based workflow management system, called WS-VLAM, which provides ways to create, control and monitor workflows applications and their components. An approach to balance the workload between the workflow instances and to collect provenance data at both system and workflow levels is also discussed. Finally, an experimental evaluation of the presented solution is performed with a biomedical application for which 3000 simulations were required to perform a Monte-Carlo study.