Tight lower bounds for query processing on streaming and external memory data

  • Authors:
  • Martin Grohe;Christoph Koch;Nicole Schweikardt

  • Affiliations:
  • Institut für Informatik, Humboldt-Universität Berlin, Germany;Database Group, Universität des Saarlandes, Saarbrücken, Germany;Institut für Informatik, Humboldt-Universität Berlin, Germany

  • Venue:
  • ICALP'05 Proceedings of the 32nd international conference on Automata, Languages and Programming
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We study a clean machine model for external memory and stream processing. We show that the number of scans of the external data induces a strict hierarchy (as long as work space is sufficiently small, e.g., polylogarithmic in the size of the input). We also show that neither joins nor sorting are feasible if the product of the number r(n) of scans of the external memory and the size s(n) of the internal memory buffers is sufficiently small, e.g., of size $o(\sqrt[n]{5})$. We also establish tight bounds for the complexity of XPath evaluation and filtering.