Toward Optimal Classifier System Performance in Non-Markov Environments

  • Authors:
  • Pier Luca Lanzi;Stewart W. Wilson

  • Affiliations:
  • Artificial Intelligence and Robotics Laboratory, Dip. di Elettronica e Informazione Politecnico di Milano Piazza Leonardo da Vinci n. 32 I-20133 Milano, Italy;Department of General Engineering, University of Illinois at Urbana-Champaign Urbana, IL 61801-2996, USA

  • Venue:
  • Evolutionary Computation
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

Wilson's (1994) bit-register memory scheme was incorporated into the XCS classifier system and investigated in a series of non-Markov environments. Two extensions to the scheme were important in obtaining near-optimal performance in the harder environments. The first was an exploration strategy in which exploration of external actions was probabilistic as in Markov environments, but internal "actions" (register settings) were selected deterministically. The second was use of a register having more bit-positions than were strictly necessary to resolve environmental aliasing. The origins and effects of the two extensions are discussed.