Learning with side information: PAC learning bounds

  • Authors:
  • P. Kuusela;D. Ocone

  • Affiliations:
  • Networking Laboratory, Helsinki University of Technology, P.O.Box 3000, FIN-02015 HUT, Finland and Department of Mathematics, Hill Center, Busch Campus, 110 Frelinghuysen Rd., Rutgers University, ...;Department of Mathematics, Hill Center, Busch Campus, 110 Frelinghuysen Rd., Rutgers University, Piscataway, NJ

  • Venue:
  • Journal of Computer and System Sciences
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper considers a modification of a PAC learning theory problem in which each instance of the training data is supplemented with side information. In this case, a transformation, given by a side-information map, of the training instance is also classified. However, the learning algorithm needs only to classify a new instance, not the instance and its value under the side information map. Side information can improve general learning rates, but not always. This paper shows that side information leads to the improvement of standard PAC learning theory rate bounds, under restrictions on the probable overlap between concepts and their images under the side information map.