Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval

  • Authors:
  • Elad Yom-Tov;Shai Fine;David Carmel;Adam Darlow

  • Affiliations:
  • IBM Haifa Research Labs, Haifa, Israel;IBM Haifa Research Labs, Haifa, Israel;IBM Haifa Research Labs, Haifa, Israel;IBM Haifa Research Labs, Haifa, Israel

  • Venue:
  • Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this article we present novel learning methods for estimating the quality of results returned by a search engine in response to a query. Estimation is based on the agreement between the top results of the full query and the top results of its sub-queries. We demonstrate the usefulness of quality estimation for several applications, among them improvement of retrieval, detecting queries for which no relevant content exists in the document collection, and distributed information retrieval. Experiments on TREC data demonstrate the robustness and the effectiveness of our learning algorithms.