State driven semantic modeling of operators in ETL workflow

Authors:
Wesley Deneke;Wingning Li;Craig Thompson
Affiliations:
University of Arkansas, Fayetteville, AR;University of Arkansas, Fayetteville, AR;University of Arkansas, Fayetteville, AR
Venue:
Journal of Computing Sciences in Colleges
Year:
2010

Citing 6
Cited 0

The Science of Programming

The Science of Programming
Conceptual modeling for ETL processes

Proceedings of the 5th ACM international workshop on Data Warehousing and OLAP
Optimizing ETL Processes in Data Warehouses

ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Mapping conceptual to logical models for ETL processes

Proceedings of the 8th ACM international workshop on Data warehousing and OLAP
Towards a Domain-Specific Modeling Language for Customer Data Integration Workflow

GPC-WORKSHOPS '08 Proceedings of the 2008 The 3rd International Conference on Grid and Pervasive Computing - Workshops
Object-oriented analysis and design with applications, third edition

Object-oriented analysis and design with applications, third edition

Quantified Score

Hi-index	0.00

Visualization

Abstract

To process the flood of digital age data, ETL tools operating on grids have provided organizations with the ability to efficiently filter, clean, and persist very large data sets by means of complex workflows. Currently, however, constructing such workflows is largely manual, human time intensive, and error prone. Existing models omit the domain related knowledge necessary to validate the structure of such large, complex ETL workflows during construction. This paper introduces the concepts of preconditions, postconditions, and field abstraction on ETL operators to provide a richer model for ETL workflow that can leverage relevant domain knowledge to represent and enforce operator constraints.