Data Load Distribution by Semi Real Time Data Warehouse

  • Authors:
  • Muhammad Younus Javed;Asim Nawaz

  • Affiliations:
  • -;-

  • Venue:
  • ICCNT '10 Proceedings of the 2010 Second International Conference on Computer and Network Technology
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Today many organizations used data warehouse for strategic decision making. Today's real-time business stresses the potential to process increasingly volumes of data at very high speed in order to stay competitive in market. Data Warehouse is populated by data extraction, transformation and loading from different data sources by software utilities called ETL (Extraction, transformation & loading). ETL process is a time consuming process as it has to process large volume of data. ETL processes must have certain completion time window and ETL process must have to finish within this time window. In this paper we discusses a technique to distribute the volume of data to be extracted, transformed and loaded into data warehouse by merging both conventional and real-time techniques, so ETL process finishes its job within its time window by utilizing ETL idle time.