Performance evaluation and experimental assessment: conscience or curse of database research?

  • Authors:
  • Ioana Manolescu;Stefan Manegold

  • Affiliations:
  • INRIA Futurs, France;CWI, Netherlands

  • Venue:
  • VLDB '07 Proceedings of the 33rd international conference on Very large data bases
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Performance, performance and performance used to be the three things that really mattered in database research. Most of our published works indeed include an experimental evaluation of the proposed techniques. However, such evaluations are sometimes seen as a "must-have" eating up the valuable space where one could describe new ideas. The experimental evaluations end up being short, lacking important information to interpret and/or reproduce the results, and often end without clear conclusion.