Ranking data with ordinal labels: optimality and pairwise aggregation

  • Authors:
  • Stéphan Clémençon;Sylvain Robbiano;Nicolas Vayatis

  • Affiliations:
  • LTCI UMR Telecom ParisTech/CNRS No. 5141, Telecom ParisTech, Paris cedex 13, France 75634;LTCI UMR Telecom ParisTech/CNRS No. 5141, Telecom ParisTech, Paris cedex 13, France 75634;CMLA UMR CNRS No. 8536, ENS Cachan & UniverSud, Cahan cedex, France 94235

  • Venue:
  • Machine Learning
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper describes key insights in order to grasp the nature of K-partite ranking. From the theoretical side, the various characterizations of optimal elements are fully described, as well as the likelihood ratio monotonicity condition on the underlying distribution which guarantees that such elements do exist. Then, a pairwise aggregation procedure based on Kendall tau is introduced to relate learning rules dedicated to bipartite ranking and solutions of the K-partite ranking problem. Criteria reflecting ranking performance under these conditions such as the ROC surface and its natural summary, the volume under the ROC surface (VUS), are then considered as targets for empirical optimization. The consistency of pairwise aggregation strategies are studied under these criteria and shown to be efficient under reasonable assumptions. Eventually, numerical results illustrate the relevance of the methodology proposed.