Pipeline-centric provenance model

Authors:
Paul Groth;Ewa Deelman;Gideon Juve;Gaurang Mehta;Bruce Berriman
Affiliations:
USC Information Sciences Institute, Marina del Rey, CA;USC Information Sciences Institute, Marina del Rey, CA;USC Information Sciences Institute, Marina del Rey, CA;USC Information Sciences Institute, Marina del Rey, CA;Infrared Processing and Analysis Ctr., Pasadena, CA
Venue:
Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science
Year:
2009

Citing 16
Cited 8

Digital Software and Data Repositories for Support of Scientific Computing

ADL '95 Selected Papers from the Digital Libraries, Research and Technology Advances
GriPhyN and LIGO, Building a Virtual Data Grid for Gravitational Wave Scientists

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Lineage retrieval for scientific data processing: a survey

ACM Computing Surveys (CSUR)
A survey of data provenance in e-science

ACM SIGMOD Record
Trio: a system for data, uncertainty, and lineage

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Pegasus: A framework for mapping complex scientific workflows onto distributed systems

Scientific Programming
Provenance-aware storage systems

ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
myExperiment: social networking for workflow-using e-scientists

Proceedings of the 2nd workshop on Workflows in support of large-scale science
The provenance of electronic data

Communications of the ACM - The psychology of security: why do good users make bad decisions?
Examining the Challenges of Scientific Workflows

Computer
Mining Taverna's semantic web of provenance

Concurrency and Computation: Practice & Experience - The First Provenance Challenge
Tracking provenance in a virtual data grid

Concurrency and Computation: Practice & Experience - The First Provenance Challenge
Efficient provenance storage

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Efficient lineage tracking for scientific workflows

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
A model of process documentation to determine provenance in mash-ups

ACM Transactions on Internet Technology (TOIT)
Workflows and e-Science: An overview of workflow system features and capabilities

Future Generation Computer Systems

Provenance meets adaptive hypermedia

Proceedings of the 21st ACM conference on Hypertext and hypermedia
The Foundations for Provenance on the Web

Foundations and Trends in Web Science
SciProv: an architecture for semantic query in provenance metadata on e-science context

ITBAM'11 Proceedings of the Second international conference on Information technology in bio- and medical informatics
Object reuse and exchange for publishing and sharing workflows

Proceedings of the 6th workshop on Workflows in support of large-scale science
Characterizing and profiling scientific workflows

Future Generation Computer Systems
Using domain-specific data to enhance scientific workflow steering queries

IPAW'12 Proceedings of the 4th international conference on Provenance and Annotation of Data and Processes
Capturing and querying workflow runtime provenance with PROV: a practical approach

Proceedings of the Joint EDBT/ICDT 2013 Workshops
Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions

Journal of Grid Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we propose a new provenance model which is tailored to a class of workflow-based applications. We motivate the approach with use cases from the astronomy community. We generalize the class of applications the approach is relevant to and propose a pipeline-centric provenance model. Finally, we evaluate the benefits in terms of storage needed by the approach when applied to an astronomy application.