On the characteristics of sequential decision problems and their impact on evolutionary computation and reinforcement learning

  • Authors:
  • André M. S. Barreto;Douglas A. Augusto;Helio J. C. Barbosa

  • Affiliations:
  • Laboratório Nacional de Computação Científica, Petrópolis, RJ, Brazil;Laboratório Nacional de Computação Científica, Petrópolis, RJ, Brazil;Laboratório Nacional de Computação Científica, Petrópolis, RJ, Brazil

  • Venue:
  • EA'09 Proceedings of the 9th international conference on Artificial evolution
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work provides a systematic review of the criteria most commonly used to classify sequential decision problems and discusses their impact on the performance of reinforcement learning and evolutionary computation. The paper also proposes a further division of one class of decision problems into two subcategories, which delimits a set of decision tasks particularly difficult for optimization techniques in general and evolutionary methods in particular. A simple computational experiment is presented to illustrate the subject.