Adaptive value function approximations in classifier systems

  • Authors:
  • Lashon B. Booker

  • Affiliations:
  • The MITRE Corporation, McLean, VA

  • Venue:
  • IWLCS'03-05 Proceedings of the 2003-2005 international conference on Learning classifier systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Previous work [1] introduced a new approach to value function approximation in classifier systems called hyperplane coding. Hyperplane coding is a closely related variation of tile coding [13] in which classifier rule conditions fill the role of tiles, and there are few restrictions on the way those "tiles" are organized. Experiments with hyperplane coding have shown that, given a relatively small population of random classifiers, it computes much better approximations than more conventional classifier system methods in which individual rules compute approximations independently. The obvious next step in this line of research is to use the approximation resources available in a random population as a starting point for a more refined approach to approximation that re-allocates resources adaptively to gain greater precision in those regions of the input space where it is needed. This paper shows how to compute such an adaptive function approximation.