Orchid: Integrating Schema Mapping and ETL

Authors:
Stefan Dessloch;Mauricio A. Hernandez;Ryan Wisnesky;Ahmed Radwan;Jindan Zhou
Affiliations:
Department of Computer Science, University of Kaiserslautern, Kaiserslautern, Germany. dessloch@informatik.uni-kl.de;IBM Almaden Research Center, San Jose, CA, US. mauricio@almaden.ibm.com;School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, US. ryan@eecs.harvard.edu;Department of Electrical and Computer Engineering, University of Miami, Miami, FL, US. a.radwan@umiami.edu;Department of Electrical and Computer Engineering, University of Miami, Miami, FL, US. j.zhou@umiami.edu
Venue:
ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Year:
2008

Citing 0
Cited 13

Towards generating ETL processes for incremental loading

IDEAS '08 Proceedings of the 2008 international symposium on Database engineering & applications
GCIP: exploiting the generation and optimization of integration processes

Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
XPEDIA: XML processing for data integration

Proceedings of the VLDB Endowment
Optimized incremental ETL jobs for maintaining data warehouses

Proceedings of the Fourteenth International Database Engineering & Applications Symposium
Model driven data warehouse using MDA and 2TUP

Journal of Computational Methods in Sciences and Engineering - Special Supplement Issue in Section A and B: Selected Papers from the ISCA International Conference on Software Engineering and Data Engineering, 2009
MapMerge: correlating independent schema mappings

Proceedings of the VLDB Endowment
Scalable data exchange with functional dependencies

Proceedings of the VLDB Endowment
A semantic approach to ETL technologies

Data & Knowledge Engineering
MapMerge: correlating independent schema mappings

The VLDB Journal — The International Journal on Very Large Data Bases
What is the IQ of your data transformation system?

Proceedings of the 21st ACM international conference on Information and knowledge management
Integrating ETL processes from information requirements

DaWaK'12 Proceedings of the 14th international conference on Data Warehousing and Knowledge Discovery
Requirement-driven creation and deployment of multidimensional and ETL designs

ER'12 Proceedings of the 2012 international conference on Advances in Conceptual Modeling
EXLEngine: executable schema mappings for statistical data processing

Proceedings of the 16th International Conference on Extending Database Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes Orchid, a system that converts declarative mapping specifications into data flow specifications (ETL jobs) and vice versa. Orchid provides an abstract operator model that serves as a common model for both transformation paradigms; both mappings and ETL jobs are transformed into instances of this common model. As an additional benefit, instances of this common model can be optimized and deployed into multiple target environments. Orchid is being deployed in FastTrack, a data transformation toolkit in IBM Information Server.