Robust reductions from ranking to classification

  • Authors:
  • Maria-Florina Balcan;Nikhil Bansal;Alina Beygelzimer;Don Coppersmith;John Langford;Gregory B. Sorkin

  • Affiliations:
  • Carnegie Melon University, Pittsburgh, PA;IBM Thomas J. Watson Research Center, Yorktown Heights, Hawthorne, NY;IBM Thomas J. Watson Research Center, Yorktown Heights, Hawthorne, NY;IDA Center for Communications Research, Princeton, NJ;Yahoo Research, New York, NY;IBM Thomas J. Watson Research Center, Yorktown Heights, Hawthorne, NY

  • Venue:
  • COLT'07 Proceedings of the 20th annual conference on Learning theory
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We reduce ranking, as measured by the Area Under the Receiver Operating Characteristic Curve (AUC), to binary classification. The core theorem shows that a binary classification regret of r on the induced binary problem implies an AUC regret of at most 2r. This is a large improvement over approaches such as ordering according to regressed scores, which have a regret transform of r → nr where n is the number of elements.