Two-Stage learning to rank for information retrieval

  • Authors:
  • Van Dang;Michael Bendersky;W. Bruce Croft

  • Affiliations:
  • Center for Intelligent Information Retrieval, Department of Computer Science, University of Massachusetts Amherst;Center for Intelligent Information Retrieval, Department of Computer Science, University of Massachusetts Amherst;Center for Intelligent Information Retrieval, Department of Computer Science, University of Massachusetts Amherst

  • Venue:
  • ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Current learning to rank approaches commonly focus on learning the best possible ranking function given a small fixed set of documents. This document set is often retrieved from the collection using a simple unsupervised bag-of-words method, e.g. BM25. This can potentially lead to learning a sub-optimal ranking, since many relevant documents may be excluded from the initially retrieved set. In this paper we propose a novel two-stage learning framework to address this problem. We first learn a ranking function over the entire retrieval collection using a limited set of textual features including weighted phrases, proximities and expansion terms. This function is then used to retrieve the best possible subset of documents over which the final model is trained using a larger set of query- and document-dependent features. Empirical evaluation using two web collections unequivocally demonstrates that our proposed two-stage framework, being able to learn its model from more relevant documents, outperforms current learning to rank approaches.