Enhancing the performance of scientific workflow execution in e-science environments by harnessing the standards based parameter sweep model

Authors:
Shahbaz Memon;Sonja Holl;Bernd Schuller;Morris Riedel;Morris Riedel;Andrew Grimshaw
Affiliations:
Juelich Supercomputing Centre (JSC), Forschungszentrum Juelich, Juelich, Germany;Juelich Supercomputing Centre (JSC), Forschungszentrum Juelich, Juelich, Germany;Juelich Supercomputing Centre (JSC), Forschungszentrum Juelich, Juelich, Germany;Juelich Supercomputing Centre (JSC), Forschungszentrum Juelich, Juelich, Germany;University of Iceland, Reykjavik, Iceland;University of Virginia, Charlottesville, Virginia
Venue:
Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery
Year:
2013

Citing 9
Cited 0

Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence

Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence
Workflows for e-Science: Scientific Workflows for Grids

Workflows for e-Science: Scientific Workflows for Grids
Parameter Space Exploration Using Scientific Workflows

ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
g-Eclipse - an integrated framework to access and maintain Grid resources

GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
A versatile execution management system for next-generation UNICORE grids

Euro-Par'06 Proceedings of the CoreGRID 2006, UNICORE Summit 2006, Petascale Computational Biology and Bioinformatics conference on Parallel processing
Taverna, reloaded

SSDBM'10 Proceedings of the 22nd international conference on Scientific and statistical database management
Towards a Powerful European DCI Based on Desktop Grids

Journal of Grid Computing
A UNICORE Plugin for HPC-Enabled Scientific Workflows in Taverna 2.2

SERVICES '11 Proceedings of the 2011 IEEE World Congress on Services
A new optimization phase for scientific workflow management systems

E-SCIENCE '12 Proceedings of the 2012 IEEE 8th International Conference on E-Science (e-Science)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Certain scientific use cases possess complex requirements to have Grid jobs executed in collections where the jobs' request contains only some variation in different parts. These scenarios can easily be tackled by a single job request which abstract this variation and can represent the same collection. The Open Grid Forum (OGF) standards community modeled this requirement through the Job Submission and Description Language (JSDL) Parameter Sweep specification, which takes a modular approach to handle different variations of parameter sweeps (e.g. document and file sweep). In this paper we present the UNICORE server environment implementing this specification build upon its existing JSDL implementation. We also demonstrate the application of UNICORE's parameter sweep extension for optimizing job executions, which are submitted as a sub-activity of a Taverna based scientific workflow. Further we validate our approach by analyzing performance of the workflow with and without using the parameter sweep extension.