Towards low overhead provenance tracking in near real-time stream filtering

  • Authors:
  • Nithya N. Vijayakumar;Beth Plale

  • Affiliations:
  • Department of Computer Science, Indiana University;Department of Computer Science, Indiana University

  • Venue:
  • IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data streams flowing from the physical environment are as unpredictable as the environment itself. Radars go down, long haul networks drop packets, and readings are corrupted on the wire. Yet the data driven scientific models and data mining algorithms do not necessarily account for the inaccuracies when assimilating the data. Low overhead provenance collection partially solves this problem. We propose a data model and collection model for near real time provenance collection. We define a system architecture for stream provenance tracking and motivate with a real-world application in meteorology forecasting.