Q-Learning with Adaptive State Segmentation (QLASS)

  • Authors:
  • Hajime Murao;Shinzo Kitamura

  • Affiliations:
  • -;-

  • Venue:
  • CIRA '97 Proceedings of the 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation
  • Year:
  • 1997

Quantified Score

Hi-index 0.00

Visualization

Abstract

Q-learning is an efficient algorithm to acquire adaptive behavior of the robot without a priori knowledge of the sensor space and the task. However, there is a problem in applying the Q-learning to the task in the real world. How to construct the state space suitable for the Q-learning without the knowledge of the sensor space? In this paper, we propose Q-learning with adaptive state segmentation (QLASS). QLASS provides a method to segment the sensor space incrementally based on sensor vectors and reinforcement signals. Experimental results show that QLASS can segment the sensor space effectively to accomplish the task. Furthermore, we show the obtained state space reveals the fitness landscape.