Query-level stability and generalization in learning to rank

  • Authors:
  • Yanyan Lan;Tie-Yan Liu;Tao Qin;Zhiming Ma;Hang Li

  • Affiliations:
  • Chinese Academy of Sciences, Beijing, P. R. China;Microsoft Research Asia, Beijing, P. R. China;Tsinghua University, Beijing, P. R. China;Chinese Academy of Sciences, Beijing, P. R. China;Microsoft Research Asia, Beijing, P. R. China

  • Venue:
  • Proceedings of the 25th international conference on Machine learning
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper is concerned with the generalization ability of learning to rank algorithms for information retrieval (IR). We point out that the key for addressing the learning problem is to look at it from the viewpoint of query. We define a number of new concepts, including query-level loss, query-level risk, and query-level stability. We then analyze the generalization ability of learning to rank algorithms by giving query-level generalization bounds to them using query-level stability as a tool. Such an analysis is very helpful for us to derive more advanced algorithms for IR. We apply the proposed theory to the existing algorithms of Ranking SVM and IRSVM. Experimental results on the two algorithms verify the correctness of the theoretical analysis.