A BPMN-Based Design and Maintenance Framework for ETL Processes

  • Authors:
  • Jose-Norberto Mazón;Esteban Zimányi;Zineb El Akkaoui;Juan Trujillo

  • Affiliations:
  • Department of Software and Computing Systems, University of Alicante, Alicante, Spain;Department of Computer & Decision Engineering CoDE, Universitéé Libre de Bruxelles, Brussels, Belgium;Department of Computer & Decision Engineering CoDE, Universitéé Libre de Bruxelles, Brussels, Belgium;Department of Software and Computing Systems, University of Alicante, Alicante, Spain

  • Venue:
  • International Journal of Data Warehousing and Mining
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Business Intelligence BI applications require the design, implementation, and maintenance of processes that extract, transform, and load suitable data for analysis. The development of these processes known as ETL is an inherently complex problem that is typically costly and time consuming. In a previous work, the authors have proposed a vendor-independent language for reducing the design complexity due to disparate ETL languages tailored to specific design tools with steep learning curves. Nevertheless, the designer still faces two major issues during the development of ETL processes: i how to implement the designed processes in an executable language, and ii how to maintain the implementation when the organization data infrastructure evolves. In this paper, the authors propose a model-driven framework that provides automatic code generation capability and ameliorate maintenance support of our ETL language. They present a set of model-to-text transformations able to produce code for different ETL commercial tools as well as model-to-model transformations that automatically update the ETL models with the aim of supporting the maintenance of the generated code according to data source evolution. A demonstration using an example is conducted as an initial validation to show that the framework covering modeling, code generation and maintenance could be used in practice.