A logical language for data and knowledge bases
A logical language for data and knowledge bases
Improving OLTP data quality using data warehouse mechanisms
SIGMOD '99 Proceedings of the 1999 ACM SIGMOD international conference on Management of data
Efficient resumption of interrupted warehouse loads
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
AJAX: an extensible data cleaning tool
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Software Engineering: A Practitioner's Approach
Software Engineering: A Practitioner's Approach
The Data Warehouse Lifecycle Toolkit: Expert Methods for Designing, Developing and Deploying Data Warehouses with CD Rom
Professional SQL Server 2000 Data Warehousing with Analysis Services
Professional SQL Server 2000 Data Warehousing with Analysis Services
Conceptual modeling for ETL processes
Proceedings of the 5th ACM international workshop on Data Warehousing and OLAP
The Challenge of Process Data Warehousing
VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
Potter's Wheel: An Interactive Data Cleaning System
Proceedings of the 27th International Conference on Very Large Data Bases
A Meta Model for Structured Workflows Supporting Workflow Transformations
ADBIS '02 Proceedings of the 6th East European Conference on Advances in Databases and Information Systems
A Transactional Approach to Parallel Data Warehouse Maintenance
DaWaK 2000 Proceedings of the 4th International Conference on Data Warehousing and Knowledge Discovery
Data Integration under Integrity Constraints
CAiSE '02 Proceedings of the 14th International Conference on Advanced Information Systems Engineering
A Transactional Model for Data Warehouse Maintenance
ER '02 Proceedings of the 21st International Conference on Conceptual Modeling
Conceptual Modelling of WorkFlows
OOER '95 Proceedings of the 14th International Conference on Object-Oriented and Entity-Relationship Modelling
An Interactive Framework for Data Cleaning
An Interactive Framework for Data Cleaning
IBIS: semantic data integration at work
CAiSE'03 Proceedings of the 15th international conference on Advanced information systems engineering
A framework for the design of ETL scenarios
CAiSE'03 Proceedings of the 15th international conference on Advanced information systems engineering
On business process model transformations
ER'00 Proceedings of the 19th international conference on Conceptual modeling
Querying through a user interface
Data & Knowledge Engineering
An ETL Tool Based on Semantic Analysis of Schemata and Instances
KES '09 Proceedings of the 13th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems: Part II
A framework for the design of ETL scenarios
CAiSE'03 Proceedings of the 15th international conference on Advanced information systems engineering
ETL workflows: from formal specification to optimization
ADBIS'07 Proceedings of the 11th East European conference on Advances in databases and information systems
Finding an application-appropriate model for XML data warehouses
Information Systems
ERP data sharing framework using the Generic Product Model (GPM)
Expert Systems with Applications: An International Journal
Model driven data warehouse using MDA and 2TUP
Journal of Computational Methods in Sciences and Engineering - Special Supplement Issue in Section A and B: Selected Papers from the ISCA International Conference on Software Engineering and Data Engineering, 2009
Updatable and evolvable transforms for virtual databases
Proceedings of the VLDB Endowment
A semantic approach to ETL technologies
Data & Knowledge Engineering
Support for user involvement in data cleaning
DaWaK'11 Proceedings of the 13th international conference on Data warehousing and knowledge discovery
A model-driven framework for ETL process development
Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP
E-ETL: framework for managing evolving etl processes
Proceedings of the 4th workshop on Workshop for Ph.D. students in information & knowledge management
QBX: a CASE tool for data mart design
ER'11 Proceedings of the 30th international conference on Advances in conceptual modeling: recent developments and new directions
Workflow based security incident management
PCI'05 Proceedings of the 10th Panhellenic conference on Advances in Informatics
A real time data extraction, transformation and loading solution for semi-structured text files
EPIA'05 Proceedings of the 12th Portuguese conference on Progress in Artificial Intelligence
Comprehensible answers to précis queries
CAiSE'06 Proceedings of the 18th international conference on Advanced Information Systems Engineering
The user interface is the conceptual model
ER'06 Proceedings of the 25th international conference on Conceptual Modeling
Context-sensitive clinical data integration
EDBT'06 Proceedings of the 2006 international conference on Current Trends in Database Technology
Modeling data warehouse schema evolution over extended hierarchy semantics
Journal on Data Semantics XIII
Ontology-Driven conceptual design of ETL processes using graph transformations
Journal on Data Semantics XIII
International Journal of Intelligent Information and Database Systems
Modeling techniques for extraction transformation and load processes: a critical review
Proceedings of the 6th Euro American Conference on Telematics and Information Systems
ICMT'12 Proceedings of the 5th international conference on Theory and Practice of Model Transformations
ACM SIGSOFT Software Engineering Notes
BPMN-based conceptual modeling of ETL processes
DaWaK'12 Proceedings of the 14th international conference on Data Warehousing and Knowledge Discovery
Scheduling strategies for efficient ETL execution
Information Systems
A BPMN-Based Design and Maintenance Framework for ETL Processes
International Journal of Data Warehousing and Mining
Hi-index | 0.00 |
Extraction-transformation-loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization and insertion into a data warehouse. In this paper, we delve into the logical design of ETL scenarios and provide a generic and customizable framework in order to support the DW designer in his task. First, we present a metamodel particularly customized for the definition of ETL activities. We follow a workflow-like approach, where the output of a certain activity can either be stored persistently or passed to a subsequent activity. Also, we employ a declarative database programming language, LDL, to define the semantics of each activity. The metamodel is generic enough to capture any possible ETL activity. Nevertheless, in the pursuit of higher reusability and flexibility, we specialize the set of our generic metamodel constructs with a palette of frequently used ETL activities, which we call templates. Moreover, in order to achieve a uniform extensibility mechanism for this library of built-ins, we have to deal with specific language issues. Therefore, we also discuss the mechanics of template instantiation to concrete activities. The design concepts that we introduce have been implemented in a tool, arktos ii, which is also presented.