Ranking and scoring using empirical risk minimization

  • Authors:
  • Stéphan Clémençon;Gábor Lugosi;Nicolas Vayatis

  • Affiliations:
  • MODALX - Université Paris X, Nanterre Cedex, France;Department of Economics, Universitat Pompeu Fabra, Barcelona, Spain;Laboratoire de Probabilités et Modèles Aléatoires, Université Paris VI, Paris Cedex, France

  • Venue:
  • COLT'05 Proceedings of the 18th annual conference on Learning Theory
  • Year:
  • 2005

Quantified Score

Hi-index 0.06

Visualization

Abstract

A general model is proposed for studying ranking problems. We investigate learning methods based on empirical minimization of the natural estimates of the ranking risk. The empirical estimates are of the form of a U-statistic. Inequalities from the theory of U-statistics and U-processes are used to obtain performance bounds for the empirical risk minimizers. Convex risk minimization methods are also studied to give a theoretical framework for ranking algorithms based on boosting and support vector machines. Just like in binary classification, fast rates of convergence are achieved under certain noise assumption. General sufficient conditions are proposed in several special cases that guarantee fast rates of convergence.