Toward Simulation-Based Optimization in Data Stream Management Systems

  • Authors:
  • Christoph Heinz;Jurgen Kramer;Tobias Riemenschneider;Bernhard Seeger

  • Affiliations:
  • Department of Mathematics and Computer Science, University of Marburg, Germany. heinzch@mathematik.uni-marburg.de;Department of Mathematics and Computer Science, University of Marburg, Germany. kraemerj@mathematik.uni-marburg.de;Department of Mathematics and Computer Science, University of Marburg, Germany. tobys@mathematik.uni-marburg.de;Department of Mathematics and Computer Science, University of Marburg, Germany. seeger@mathematik.uni-marburg.de

  • Venue:
  • ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Our demonstration introduces a novel system architecture which massively facilitates optimization in data stream management systems (DSMS). The basic idea is to decouple optimization from the operative system by means of a secondary optimization system, which bears the burden of determining new query plans. Within the secondary system, which typically runs on a separate machine, we utilize suitable statistical models of the original data streams to simulate them. As the simulation can run at much faster rates, we are able to examine and assess new query plans in a shorter period of time without running the risk of deteriorating the original plan; we only migrate practically approved plans into the operative system. In our demonstration, we will present our prototypical implementation of this optimization architecture. We will demonstrate the interaction between primary and secondary system as well as the key features of the whole optimization process.