Adaptive Segmentation for Scientific Databases

  • Authors:
  • Milena Ivanova;Martin L. Kersten;Niels Nes

  • Affiliations:
  • CWI, Amsterdam, The Netherlands. milena@cwi.nl;CWI, Amsterdam, The Netherlands. mk@cwi.nl;CWI, Amsterdam, The Netherlands. niels@cwi.nl

  • Venue:
  • ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

In this paper we explore database segmentation in the context of a column-store DBMS targeted at a scientific database. We present a novel hardware- and scheme-oblivious segmentation algorithm, which learns and adapts to the workload immediately. The approach taken is to capitalize on (intermediate) query results, such that future queries benefit from a more appropriate data layout. The algorithm is implemented as an extension of a complete DBMS and evaluated against a real-life workload. It demonstrates significant performance gains without DBA assistance.