Understanding provenance black boxes

  • Authors:

  • Adriane Chapman;H. V. Jagadish

  • Affiliations:

  • The MITRE Corporation, McLean, USA;University of Michigan, Ann Arbor, USA

  • Venue:
  • Distributed and Parallel Databases
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Current provenance stores associated with workflow management systems (WfMSs) capture enough coarse-grained information to describe which datasets were used and which processes were run. While this information is enough to rebuild a workflow run, it is not enough to facilitate user understanding. Because the data is manipulated via a series of black boxes, it is often impossible for a human to understand what happened to the data. In this work, we highlight the missing information that can assist user understanding. Unfortunately, provenance information is already very complex and difficult for a user to comprehend, which can be exacerbated by adding the extra information needed for deeper blackbox understanding. In order to alleviate this, we develop a model of provenance answers that follow a "roll up", "drill down" strategy. We evaluate these techniques to determine if users have better understanding of provenance information. We show how this information can be captured by workflow management systems, and that the structures and information needed for this model are a negligible addition to standard provenance stores. Finally, we implement these techniques in a real provenance system, and evaluate implementation feasibility.