Lower Bound Methods and Separation Results for On-Line Learning Models

  • Authors:
  • Wolfgang Maass;György Turán

  • Affiliations:
  • Institute for Theoretical Computer Science, Technische Universität Graz, Klosterwiesgasse 32, A-8010 Graz, Austria, and the University of Illinois at Chicago. MAASS@IGI.TU-GRAZ ...;Department of Mathematics, Statistics and Computer Science, University of Illinois at Chicago, IL, and Automata Theory Research Group of the Hungarian Academy of Sciences, Szeged, Hungary. ...

  • Venue:
  • Machine Learning - Computational learning theory
  • Year:
  • 1992

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the complexity of concept learning in various common models for on-line learning, focusing on methods for proving lower bounds to the learning complexity of a concept class. Among others, we consider the model for learning with equivalence and membership queries. For this model we give lower bounds on the number of queries that are needed to learn a concept class {\cal C} in terms of the Vapnik-Chervonenkis dimension of {\cal C}, and in terms of the complexity of learning {\cal C} with arbitrary equivalence queries. Furthermore, we survey other known lower bound methods and we exhibit all known relationships between learning complexities in the models considered and some relevant combinatorial parameters. As it turns out, the picture is almost complete. This paper has been written so that it can be read without previous knowledge of Computational Learning Theory.