Bayesian estimation of rule accuracy in UCS

  • Authors:
  • James A. R. Marshall;Gavin Brown;Tim Kovacs

  • Affiliations:
  • University of Bristol, Bristol, United Kingdom;University of Manchester, Manchester, United Kingdom;University of Bristol, Bristol, United Kingdom

  • Venue:
  • Proceedings of the 9th annual conference companion on Genetic and evolutionary computation
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning Classifier Systems differ from many other classification techniques, in that new rules are constantly discovered and evaluated. This feature of LCS gives rise to an important problem, how to deal with estimates of rule accuracy that are unreliable due to the small number of performance samples available. In this paper we highlight the importance of this problem for LCS, summarise previous heuristic approaches to the problem, and propose instead the use of principles from Bayesian estimation. In particular we argue that discounting estimates of accuracy based on inexperience must be recognised as a crucially important part of the specification of LCS, and must be well motivated. We present experimental results on using the Bayesian approach to discounting, consider how to estimate the parameters for it, and identify benefits of its use for other areas of LCS.