Diagnosing Estimation Errors in Page Counts Using Execution Feedback

  • Authors:
  • Surajit Chaudhuri;Vivek Narasayya;Ravishankar Ramamurthy

  • Affiliations:
  • Microsoft Research, One Microsoft Way, Redmond WA USA. surajitc@microsoft.com;Microsoft Research, One Microsoft Way, Redmond WA USA. viveknar@microsoft.com;Microsoft Research, One Microsoft Way, Redmond WA USA. ravirama@microsoft.com

  • Venue:
  • ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Errors in estimating page counts can lead to poor choice of access methods and in turn to poor quality plans. Although there is past work in using execution feedback for accurate cardinality estimation, the problem of inaccurate estimation of page counts has not been addressed. In this paper, we present novel mechanisms for diagnosing errors in page count by monitoring query execution at low overhead. Detection of inaccuracy in the optimizer estimates of page count can be leveraged by database administrators to improve plan quality. We have prototyped our techniques in the Microsoft SQL Server engine, and our experiments demonstrate the ability to estimate page counts accurately using execution feedback with low overhead. For queries on several real world databases, we observe significant improvement in plan quality when page counts obtained from execution feedback are used instead of the traditional optimizer estimations.