Theoretical and Empirical Analysis of Reward Shaping in Reinforcement Learning

  • Authors:
  • Marek Grzes;Daniel Kudenko

  • Affiliations:
  • -;-

  • Venue:
  • ICMLA '09 Proceedings of the 2009 International Conference on Machine Learning and Applications
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Reinforcement learning suffers scalability problems due to the state space explosion and the temporal credit assignment problem. Knowledge-based approaches have received a significant attention in the area. Reward shaping is a particular approach to incorporate domain knowledge into reinforcement learning. Theoretical and empirical analysis of this paper reveals important properties of this principle, especially the influence of the reward type, MDP discount factor, and the way of evaluating the potential function on the performance.