Surrogate regret bounds for proper losses

  • Authors:
  • Mark D. Reid;Robert C. Williamson

  • Affiliations:
  • Australian National University, Canberra, Australia;Australian National University and NICTA, Canberra, Australia

  • Venue:
  • ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

We present tight surrogate regret bounds for the class of proper (i.e., Fisher consistent) losses. The bounds generalise the margin-based bounds due to Bartlett et al. (2006). The proof uses Taylor's theorem and leads to new representations for loss and regret and a simple proof of the integral representation of proper losses. We also present a different formulation of a duality result of Bregman divergences which leads to a simple demonstration of the convexity of composite losses using canonical link functions.