Graph-based modeling of ETL activities with multi-level transformations and updates

Authors:
Alkis Simitsis;Panos Vassiliadis;Manolis Terrovitis;Spiros Skiadopoulos
Affiliations:
Dept. of Electrical and Computer Eng., National Technical University of Athens, Athens, Hellas;Dept. of Computer Science, University of Ioannina, Ioannina, Hellas;Dept. of Electrical and Computer Eng., National Technical University of Athens, Athens, Hellas;Dept. of Electrical and Computer Eng., National Technical University of Athens, Athens, Hellas
Venue:
DaWaK'05 Proceedings of the 7th international conference on Data Warehousing and Knowledge Discovery
Year:
2005

Citing 5
Cited 9

Logic programming and databases

Logic programming and databases
AJAX: an extensible data cleaning tool

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Conceptual modeling for ETL processes

Proceedings of the 5th ACM international workshop on Data Warehousing and OLAP
Potter's Wheel: An Interactive Data Cleaning System

Proceedings of the 27th International Conference on Very Large Data Bases
A framework for the design of ETL scenarios

CAiSE'03 Proceedings of the 15th international conference on Advanced information systems engineering

Data management research at the Knowledge and Database Systems Lab: (NTU Athens)

ACM SIGMOD Record
Towards generating ETL processes for incremental loading

IDEAS '08 Proceedings of the 2008 international symposium on Database engineering & applications
pygrametl: a powerful programming framework for extract-transform-load programmers

Proceedings of the ACM twelfth international workshop on Data warehousing and OLAP
ETL workflows: from formal specification to optimization

ADBIS'07 Proceedings of the 11th East European conference on Advances in databases and information systems
Support for user involvement in data cleaning

DaWaK'11 Proceedings of the 13th international conference on Data warehousing and knowledge discovery
E-ETL: framework for managing evolving etl processes

Proceedings of the 4th workshop on Workshop for Ph.D. students in information & knowledge management
A multiversion-based multidimensional model

DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Policy-Regulated management of ETL evolution

Journal on Data Semantics XIII
What-if analysis for data warehouse evolution

DaWaK'07 Proceedings of the 9th international conference on Data Warehousing and Knowledge Discovery

Quantified Score

Hi-index	0.00

Visualization

Abstract

Extract-Transform-Load (ETL) workflows are data centric workflows responsible for transferring, cleaning, and loading data from their respective sources to the warehouse. In this paper, we build upon existing graph-based modeling techniques that treat ETL workflows as graphs by (a) extending the activity semantics to incorporate negation, aggregation and self-joins, (b) complementing querying semantics with insertions, deletions and updates, and (c) transforming the graph to allow zoom-in/out at multiple levels of abstraction (i.e., passing from the detailed description of the graph at the attribute level to more compact variants involving programs, relations and queries and vice-versa).