Reinforcement learning for problems with symmetrical restricted states

  • Authors:
  • M. A. S. Kamal;Junichi Murata

  • Affiliations:
  • Graduate School of Information Science and Electrical Engineering, Kyushu University, 744 Motooka, Nishi-ku, Fukuoka, Japan;Graduate School of Information Science and Electrical Engineering, Kyushu University, 744 Motooka, Nishi-ku, Fukuoka, Japan

  • Venue:
  • Robotics and Autonomous Systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

A reinforcement learning method is proposed that can utilize parts of states and their partial symmetries to solve a problem efficiently. In most cases the action selection does not need considering all the states but only needs looking at parts of states or restricted state of corresponding action. Moreover, restricted states of different actions are symmetrical, and thus the action value function based on restricted states can be shared which further reduces the reinforcement learning problem size. The method is compared, in terms of simulation results and other aspects, with other standard reinforcement learning methods.