A system for managing data provenance in in silico experiments

Authors:
Jarrod Trevathan;Ian M. Atkinson;Wayne W. Read;Nigel Sim;Chris Christensen
Affiliations:
James Cook University, Douglas, Townsville, Queensland, Australia;James Cook University, Douglas, Townsville, Queensland, Australia;James Cook University, Douglas, Townsville, Queensland, Australia;James Cook University, Douglas, Townsville, Queensland, Australia;James Cook University, Douglas, Townsville, Queensland, Australia
Venue:
ADC '11 Proceedings of the Twenty-Second Australasian Database Conference - Volume 115
Year:
2011

Citing 12
Cited 0

The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Chimera: AVirtual Data System for Representing, Querying, and Automating Data Derivation

SSDBM '02 Proceedings of the 14th International Conference on Scientific and Statistical Database Management
Data Provenance: Some Basic Issues

FST TCS 2000 Proceedings of the 20th Conference on Foundations of Software Technology and Theoretical Computer Science
The SDSC storage resource broker

CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
Practical Lineage Tracing in Data Warehouses

ICDE '00 Proceedings of the 16th International Conference on Data Engineering
Earth System Science Workbench: A Data Management Infrastructure for Earth Science Products

SSDBM '01 Proceedings of the 13th International Conference on Scientific and Statistical Database Management
A survey of data provenance in e-science

ACM SIGMOD Record
Taverna: a tool for the composition and enactment of bioinformatics workflows

Bioinformatics
Metadata in the collaboratory for multi-scale chemical science

DCMI '03 Proceedings of the 2003 international conference on Dublin Core and metadata applications: supporting communities of discourse and practice---metadata research & applications
Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities

HPCC '08 Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and Communications
ICAT: Integrating Data Infrastructure for Facilities Based Science

E-SCIENCE '09 Proceedings of the 2009 Fifth IEEE International Conference on e-Science
Provenance collection support in the kepler scientific workflow system

IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data

Quantified Score

Hi-index	0.00

Visualization

Abstract

In silico experiments use computers or computer simulation to speed up the rate at which scientific discoveries are made. However, the voluminous amounts of data generated in such experiments is often recorded in an ad hoc manner without regard to workflow, and often lacks rigorous business rules. The absence of stringent auditing and reporting policies makes it difficult to repeat experiments and largely denies independent parties the ability to verify study results. This paper presents a data provenance management system based on the utility of the ICAT metadata storage service as a viable schema for representing in silico experiments. The system provides a portal interface to integrate ICAT with job execution. We have built on a data repository which can handle arbitrary data size, complexity and type. This can be practically used to compare, validate and aid in the repetition of historic experiments. Furthermore, data can be verified via external repositories/sources which will ultimately enhance the scientific merit of in silico experimentation. Our proposed system augments existing applications and therefore does not require users to modify their current experimentation platform. A test case for a pharmacological study is presented to illustrate the proposed system's versatility for reporting and auditing of experiments and their results.