Conceptual modeling for ETL processes
Proceedings of the 5th ACM international workshop on Data Warehousing and OLAP
A survey of approaches to automatic schema matching
The VLDB Journal — The International Journal on Very Large Data Bases
Optimizing ETL Processes in Data Warehouses
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
State-Space Optimization of ETL Workflows
IEEE Transactions on Knowledge and Data Engineering
Mapping conceptual to logical models for ETL processes
Proceedings of the 8th ACM international workshop on Data warehousing and OLAP
Designing ETL processes using semantic web technologies
DOLAP '06 Proceedings of the 9th ACM international workshop on Data warehousing and OLAP
A method for the mapping of conceptual designs to logical blueprints for ETL processes
Decision Support Systems
A generic and customizable framework for the design of ETL scenarios
Information Systems - Special issue: The 15th international conference on advanced information systems engineering (CAiSE 2003)
Graph-based modeling of ETL activities with multi-level transformations and updates
DaWaK'05 Proceedings of the 7th international conference on Data Warehousing and Knowledge Discovery
Blueprints and measures for ETL workflows
ER'05 Proceedings of the 24th international conference on Conceptual Modeling
Flexible and customizable NL representation of requirements for ETL processes
NLDB'07 Proceedings of the 12th international conference on Applications of Natural Language to Information Systems
Data integration flows for business intelligence
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
TTL: a transformation, transference and loading approach for active monitoring
DaWaK'11 Proceedings of the 13th international conference on Data warehousing and knowledge discovery
E-ETL: framework for managing evolving etl processes
Proceedings of the 4th workshop on Workshop for Ph.D. students in information & knowledge management
Hi-index | 0.00 |
In this paper, we present our work on a framework towards the modeling and optimization of Extraction-Transformation-Loading (ETL) workflows. The goal of this research was to facilitate, manage, and optimize the design and implementation of the ETL workflows both during the initial design and deployment stage, as well as, during the continuous evolution of a data warehouse. In particular, we present our results which include: (a) the provision of a novel conceptual model for the tracing of inter-attribute relationships and the respective ETL transformations in the early stages of a data warehouse project, along with an attempt to use ontology-based mechanisms to semi-automatically capture the semantics and the relationships among the various sources; (b) the provision of a novel logical model for the representation of ETL workflows with two main characteristics: genericity and customization; (c) the semi-automatic transition from the conceptual to the logical model for ETL workflows; and (d) the tuning of an ETL workflow for the optimization of the execution order of its operations. Finally, we discuss some issues on future work in the area that we consider important and a step towards the incorporation of the above research results to other areas as well.