Incorporating query difference for learning retrieval functions in information retrieval

  • Authors:
  • Hongyuan Zha;Zhaohui Zheng;Haoying Fu;Gordon Sun

  • Affiliations:
  • Pennsylvania State University, University Park, PA;Yahoo Inc., Sunnyvale, CA;Yahoo Inc., Sunnyvale, CA;Yahoo Inc., Sunnyvale, CA

  • Venue:
  • SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We discuss information retrieval methods that aim at serving a diverse stream of user queries. We propose methods that emphasize the importance of taking into consideration of query difference in learning effective retrieval functions. We formulate the problem as a multi-task learning problem using a risk minimization framework. In particular, we show how to calibrate the empirical risk to incorporate query difference in terms of introducing nuisance parameters in the statistical models, and we also propose an alternating optimization method to simultaneously learn the retrieval function and the nuisance parameters. We illustrate the effectiveness of the proposed methods using modeling data extracted from a commercial search engine.