Automatic search engine performance evaluation with click-through data analysis

  • Authors:
  • Yiqun Liu;Yupeng Fu;Min Zhang;Shaoping Ma;Liyun Ru

  • Affiliations:
  • Tsinghua University;Tsinghua University;Tsinghua University;Tsinghua University;Sohu Inc. R&D center

  • Venue:
  • Proceedings of the 16th international conference on World Wide Web
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Performance evaluation is an important issue in Web search engine researches. Traditional evaluation methods rely on much human efforts and are therefore quite time-consuming. With click-through data analysis, we proposed an automatic search engine performance evaluation method. This method generates navigational type query topics and answers automatically based on search users. querying and clicking behavior. Experimental results based on a commercial Chinese search engine's user logs show that the automatically method gets a similar evaluation result with traditional assessor-based ones.