Simultaneous Pipelining in QPipe: Exploiting Work Sharing Opportunities Across Queries

  • Authors:
  • Kun Gao;Stavros Harizopoulos;Ippokratis Pandis;Vladislav Shkapenyuk;Anastassia Ailamaki

  • Affiliations:
  • Carnegie Mellon University;MIT CSAIL;Carnegie Mellon University;Rutgers University;Carnegie Mellon University

  • Venue:
  • ICDE '06 Proceedings of the 22nd International Conference on Data Engineering
  • Year:
  • 2006

Quantified Score

Hi-index 0.01

Visualization

Abstract

Data warehousing and scientific database applications operate on massive datasets and are characterized by complex queries accessing large portions of the database. Concurrent queries often exhibit high data and computation overlap, e.g., they access the same relations on disk, compute similar aggregates, or share intermediate results. Unfortunately, run-time sharing in modern database engines is limited by the paradigm of invoking an independent set of operator instances per query, potentially missing sharing opportunities if the buffer pool evicts data early.