Why is web search so hard... to evaluate?

  • Authors:
  • Daniel E. Rose

  • Affiliations:
  • Yahoo! Inc.

  • Venue:
  • Journal of Web Engineering
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Web search has several important characteristics that distinguish it from traditional information retrieval: the often adversarial relationship between content creators and search engine designers, the nature of the corpus, and the multiplicity of user goals. In addition to making the search task itself difficult, these characteristics make it particularly hard to evaluate search effectiveness. In this paper, we examine these characteristics and then consider the problems with several different standard evaluation techniques.