A probabilistic model for data cube compression and query approximation

  • Authors:

  • Rokia Missaoui;Cyril Goutte;Anicet Kouomou Choupo;Ameur Boujenoui

  • Affiliations:

  • University of Quebec in Outaouais, Gatineau, PQ, Canada;NRC Institute for Information Technology, Gatineau, PQ, Canada;University of Quebec in Outaouais, Gatineau, PQ, Canada;University of Ottawa, Ottawa, ON, Canada

  • Venue:
  • Proceedings of the ACM tenth international workshop on Data warehousing and OLAP
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Databases and data warehouses contain an overwhelming volume of information that users must wade through in order to extract valuable and actionable knowledge to supportthe decision-making process. This contribution addresses the problem of automatically analyzing large multidimensional tables to get a concise representation of data, identify patterns and provide approximate answers to queries. Since data cubes are nothing but multi-way tables, we propose to analyze the potential of a probabilistic modeling technique, called non-negative multi-way array factorization, for approximating aggregate and multidimensional values. Using such a technique, we compute the set of components (clusters) that best fit the initial data set and whose superposition approximates the original data. The generated components can then be exploited for approximately answering OLAP queries such as roll-up, slice and dice operations. The proposed modeling technique will then be compared against the log-linear modeling technique which has already been used in the literature for compression and outlier detection in data cubes. Finally, three data sets will be used to discuss the potential benefits of non-negative multiway array factorization.