Exploiting random walks for learning

  • Authors:
  • Peter L. Bartlett;Paul Fischer;Klaus-Uwe Höffgen

  • Affiliations:
  • Research School of Information Sciences and Engineering, Australian National University, Canberra, 0200 Australia;Informatics and Mathematical Modelling, Technical University of Denmark, DK-2800 Kgs. Lyngby, Denmark;Lehrstuhl Informatik II, Universität Dortmund, D-44221 Dortmund, Germany

  • Venue:
  • Information and Computation
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we consider an approach to passive learning. In contrast to the classical PAC model we do not assume that the examples are independently drawn according to an underlying distribution, but that they are generated by a time-driven process. We define deterministic and probabilistic learning models of this sort and investigate the relationships between them and with other models. The fact that successive examples are related can often be used to gain additional information similar to the information gained by membership queries. We show how this can be used to design on-line prediction algorithms. In particular, we present efficient algorithms for exactly identifying Boolean threshold functions and 2-term RSE, and for learning 2-term-DNF, when the examples are generated by a random walk on {0, 1}n.