Does snooping help?

  • Authors:
  • V. V. V'yugin

  • Affiliations:
  • Univ. of London, Surrey, UK

  • Venue:
  • Theoretical Computer Science
  • Year:
  • 2002

Quantified Score

Hi-index 5.23

Visualization

Abstract

One of the most efficient way of improving the performance of learning algorithms is "snooping", i.e. using some information about the data to be predicted for choosing the parameters of the learning algorithm or the learning algorithm itself. Allowing different degrees of snooping makes it possible to attain a better performance LossP(x) of a prediction strategy P on the given data set x. We study the "snooping curves" Lx()=infK(P)LossP(x), where K(P) is the Kolmogorov complexity of the prediction strategy P. We prove that every non-increasing function can be approximated with arbitrary precision by some snooping function Lx. Our framework is that of on-line prediction; for simplicity we assume that sequences x are binary.