The anticipatory classifier system and genetic generalization

  • Authors:
  • A. Martin V. Butz;B. David E. Goldberg;C. Wolfgang Stolzmann

  • Affiliations:
  • Department of Cognitive Psychology, University of Würzburg, Würzburg, Germany (E-mail:butz@psychologie.uni-wuerzburg.de);Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, Illinois, USA (E-mail: deg@illigal.ge.uiuc.edu);DaimlerChrysler AG, Research and Technology, Berlin, Germany (E-mail: Wolfgang.Stolzmann@daimlerchrysler.com)

  • Venue:
  • Natural Computing: an international journal
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

The anticipatory classifier system (ACS)combines the learning classifier system frameworkwith the cognitive learning theory ofanticipatory behavioral control. The result is an evolutionary system thatbuilds a complete and generalized predictiveenvironmental model. Reinforcement learningtechniques are applied to form a behavioralpolicy represented in the model. After providingsome background as well as outlining the objectives of the system, we explainin detail all involved current processes. Furthermore, we analyze thedeficiency of over-specialization in the anticipatory learning process (ALP),the main learning mechanism in the ACS. Consequently, we introduce a geneticalgorithm (GA) to the ACS that is meant for generalization of over-specializedclassifiers. We show that it is possible to form a symbiosis between a directedspecialization and a genetic generalization mechanism achieving a learningmechanism that evolves a complete, accurate, and compact description of theperceived environment. Results in three different environmental settingsconfirm the usefulness of the genetic algorithm in the ACS. Finally, we discuss future research directions.