Kepler/pPOD: Scientific Workflow and Provenance Support for Assembling the Tree of Life

Authors:
Shawn Bowers;Timothy Mcphillips;Sean Riddle;Manish Kumar Anand;Bertram Ludäscher
Affiliations:
UC Davis Genome Center, University of California, Davis,;UC Davis Genome Center, University of California, Davis,;UC Davis Genome Center, University of California, Davis,;Department of Computer Science, University of California, Davis,;UC Davis Genome Center, University of California, Davis, and Department of Computer Science, University of California, Davis,
Venue:
Provenance and Annotation of Data and Processes
Year:
2008

Citing 11
Cited 6

Triana: A Graphical Web Service Composition and Execution Toolkit

ICWS '04 Proceedings of the IEEE International Conference on Web Services
Taverna: lessons in creating a workflow environment for the life sciences: Research Articles

Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Scientific workflow management and the Kepler system: Research Articles

Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Zoom*UserViews: querying relevant provenance in workflow systems

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Provenance in collection-oriented scientific workflows

Concurrency and Computation: Practice & Experience - The First Provenance Challenge
Special Issue: The First Provenance Challenge

Concurrency and Computation: Practice & Experience - The First Provenance Challenge
Scientific workflow design for mere mortals

Future Generation Computer Systems
Project histories: managing data provenance across collection-oriented scientific workflow runs

DILS'07 Proceedings of the 4th international conference on Data integration in the life sciences
Collection-Oriented scientific workflows for integrating and analyzing biological data

DILS'06 Proceedings of the Third international conference on Data Integration in the Life Sciences
Provenance collection support in the kepler scientific workflow system

IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
A framework for comparing models of computation

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems

Exploring Scientific Workflow Provenance Using Hybrid Queries over Nested Data and Lineage Graphs

SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Scientific Workflows: Business as Usual?

BPM '09 Proceedings of the 7th International Conference on Business Process Management
Storing, reasoning, and querying OPM-compliant scientific workflow provenance using relational databases

Future Generation Computer Systems
Database support for exploring scientific workflow provenance graphs

SSDBM'12 Proceedings of the 24th international conference on Scientific and Statistical Database Management
Declarative rules for inferring fine-grained data provenance from scientific workflow execution traces

IPAW'12 Proceedings of the 4th international conference on Provenance and Annotation of Data and Processes
Characterizing workflow-based activity on a production e-infrastructure using provenance data

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

The complexity of scientific workflows for analyzing biological data creates a number of challenges for current workflow and provenance systems. This complexity is due in part to the nature of scientific data (e.g., heterogeneous, nested data collections) and the programming constructs required for automation (e.g., nested workflows, looping, pipeline parallelism). We present an extended version of the Kepler scientific workflow system to address these challenges, tailored for the systematics community. Our system combines novel approaches for representing scientific data, modeling and automating complex analyses, and recording and browsing associated provenance information.