On the Logical Modeling of ETL Processes
CAiSE '02 Proceedings of the 14th International Conference on Advanced Information Systems Engineering
Quality Models to Design Software Architectures
TOOLS '01 Proceedings of the Technology of Object-Oriented Languages and Systems
Reo: a channel-based coordination model for component composition
Mathematical Structures in Computer Science
Advances in business process management
Data & Knowledge Engineering - Special issue: Advances in business process management
Modeling component connectors in Reo by constraint automata
Science of Computer Programming - Special issue on second international workshop on foundations of coordination languages and software architectures (FOCLASA'03)
The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming and Delivering Data
Web services choreography and orchestration in Reo and constraint automata
Proceedings of the 2007 ACM symposium on Applied computing
Using Reo for Service Coordination
ICSOC '07 Proceedings of the 5th international conference on Service-Oriented Computing
Data Warehouse Design: Modern Principles and Methodologies
Data Warehouse Design: Modern Principles and Methodologies
Defining ETL worfklows using BPMN and BPEL
Proceedings of the ACM twelfth international workshop on Data warehousing and OLAP
A framework for the design of ETL scenarios
CAiSE'03 Proceedings of the 15th international conference on Advanced information systems engineering
Leveraging business process models for ETL design
ER'10 Proceedings of the 29th international conference on Conceptual modeling
A model-driven framework for ETL process development
Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP
BPMN-based conceptual modeling of ETL processes
DaWaK'12 Proceedings of the 14th international conference on Data Warehousing and Knowledge Discovery
Automatic code generation for the orchestration of web services with reo
ESOCC'12 Proceedings of the First European conference on Service-Oriented and Cloud Computing
BPMN patterns for ETL conceptual modelling and validation
ISMIS'12 Proceedings of the 20th international conference on Foundations of Intelligent Systems
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
| Hi-index | 0.00 |
The formalization of software patterns has proven to be very useful in software developing, improving systems communication, data interchange across platforms, and simplifying the integration of processes and data flows. Populating a data warehouse (ETL) is often a very complex task demanding significant computational resources. It faces many drawbacks during its design and implementation, involving not only large volumes of data that must be processed but also undesirable change of business requirements. All of this leads frequently to reuse significant parts of other ETL implementations, adapting data structures and processes to comply with new requirements. Additionally, we believe that it's necessary a more simply and reliable approach for ETL conceptual modelling covering the "lack of mature" of this important part of ETL development. In this paper we explored a new approach to ETL conceptual modelling using the Reo coordination language, trying to evaluate its adequacy and expressiveness on the coordination of ETL tasks. A pattern-based approach was designed to map typical operations used in real world ETL scenarios from an initial Reo specification. For demonstration purposes, we present and discuss as two case studies, a slowly changing dimension and a surrogated key pipelining processes.