An Additive Reinforcement Learning

  • Authors:
  • Takeshi Mori;Shin Ishii

  • Affiliations:
  • Kyoto University, Gokasho, Uji, Kyoto, Japan 611-0011;Kyoto University, Gokasho, Uji, Kyoto, Japan 611-0011

  • Venue:
  • ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In reinforcement learning, preparing basis functions requires a certain amount of prior knowledge and is in general a difficult task. To overcome this difficulty, an adaptive basis function construction technique has been proposed by Keller et al. recently, but it requires excessive computational cost. We propose an efficient approach to this context, in which the problem of approximating the value function is naturally decomposed into a number of sub-problems, each of which can be solved at small computational cost. Computer experiments show that the cpu-time needed by our method is much smaller than that of the existing method.