An efficient method for maintaining data cubes incrementally

  • Authors:

  • Ki Yong Lee;Yon Dohn Chung;Myoung Ho Kim

  • Affiliations:

  • Department of Computer Science, KAIST, 373-1 Yuseong-Gu, Guseong-Dong, Daejeon 305-701, South Korea;Department of Computer Science and Engineering, Korea University, 5 Ga, Anam-Dong, Seongbuk-Gu, Seoul 136-713, South Korea;Department of Computer Science, KAIST, 373-1 Yuseong-Gu, Guseong-Dong, Daejeon 305-701, South Korea

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2010

Quantified Score

Hi-index 0.07

Visualization

Abstract

The data cube operator computes group-bys for all possible combinations of a set of dimension attributes. Since computing a data cube typically incurs a considerable cost, the data cube is often precomputed and stored as materialized views in data warehouses. A materialized data cube needs to be updated when the source relations are changed. The incremental maintenance of a data cube is to compute and propagate only its changes, rather than recompute the entire data cube from scratch. For n dimension attributes, the data cube consists of 2^n group-bys, each of which is called a cuboid. To incrementally maintain a data cube with 2^n cuboids, the conventional methods compute 2^ndelta cuboids, each of which represents the change of a cuboid. In this paper, we propose an efficient incremental maintenance method that can maintain a data cube using only a subset of 2^n delta cuboids. We formulate an optimization problem to find the optimal subset of 2^n delta cuboids that minimizes the total maintenance cost, and propose a heuristic solution that allows us to maintain a data cube using only n@?n/2@? delta cuboids. As a result, the cost of maintaining a data cube is substantially reduced. Through various experiments, we show the performance advantages of the proposed method over the conventional methods. We also extend the proposed method to handle partially materialized cubes and dimension hierarchies.