Survey and evaluation of query intent detection methods

  • Authors:

  • David J. Brenes;Daniel Gayo-Avello;Kilian Pérez-González

  • Affiliations:

  • Indigo Group, Oviedo, Spain;University of Oviedo, Oviedo, Spain;University of Oviedo, Spain

  • Venue:
  • Proceedings of the 2009 workshop on Web Search Click Data
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

User interactions with search engines reveal three main underlying intents, namely navigational, informational, and transactional. By providing more accurate results depending on such query intents the performance of search engines can be greatly improved. Therefore, query classification has been an active research topic for the last years. However, while query topic classification has deserved a specific bakeoff, no evaluation campaign has been devoted to the study of automatic query intent detection. In this paper some of the available query intent detection techniques are reviewed, an evaluation framework is proposed, and it is used to compare those methods in order to shed light on their relative performance and drawbacks. As it will be shown, manually prepared gold-standard files are much needed, and traditional pooling is not the most feasible evaluation method. In addition to this, future lines of work in both query intent detection and its evaluation are proposed.