Distributed construction of data cubes from tuple stream

  • Authors:
  • Teppei Shimada;Takayuki Tsuchida;Tatsuo Tsuji;Ken Higuchi

  • Affiliations:
  • University of Fukui, Fukui, Japan;University of Fukui, Fukui, Japan;University of Fukui, Fukui, Japan;University of Fukui, Fukui, Japan

  • Venue:
  • Proceedings of the 12th International Conference on Information Integration and Web-based Applications & Services
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a distributed construction scheme of MOLAP data cubes in related sites on the network. The server that directly receives tuple data sent from tuple generation source constructs the base cuboid, and sends them to downstream sites in tuple stream. The downstream site receives the tuple data to aggregate and construct its own cuboid whose dimension is lower than the upstream cuboid, then sends the aggregated data to its downstream sites. Using the implementation scheme of multidimensional datasets based on the history-offset tuple encoding method, the tuple stream can be processed efficiently to construct cuboids in real-time on each site, while MOLAP operations can be processed against one of the data cube versions in background. In this paper, we describe our tuple stream processing scheme and distributed data cube construction, then evaluate the required communication cost.