Reinforcement Learning: Insights from Interesting Failures in Parameter Selection

  • Authors:
  • Wolfgang Konen;Thomas Bartz---Beielstein

  • Affiliations:
  • Faculty for Computer Science and Engineering Science, Cologne University of Applied Sciences, Gummersbach, Germany 51643;Faculty for Computer Science and Engineering Science, Cologne University of Applied Sciences, Gummersbach, Germany 51643

  • Venue:
  • Proceedings of the 10th international conference on Parallel Problem Solving from Nature: PPSN X
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigate reinforcement learning methods, namely the temporal difference learning TD(茂戮驴) algorithm, on game-learning tasks. Small modifications in algorithm setup and parameter choice can have significant impact on success or failure to learn. We demonstrate that small differences in input features influence significantly the learning process. By selecting the right feature set we found good results within only 1/100 of the learning steps reported in the literature. Different metrics for measuring success in a reproducible manner are developed. We discuss why linear output functions are often preferable compared to sigmoid output functions.