Real-time dynamic fuzzy Q-learning and control of mobile robots

  • Authors:
  • Chang Deng;Meng Joo Er

  • Affiliations:
  • Instrumentation and Systems Engineering Laboratory, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore;Instrumentation and Systems Engineering Laboratory, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore

  • Venue:
  • ICECS'03 Proceedings of the 2nd WSEAS International Conference on Electronics, Control and Signal Processing
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a new approach of controlling a mobile robot using the Dynamic Fuzzy Q-Learning method. Self-organizing fuzzy inference is introduced to calculate actions and Q-functions so as to enable us to deal with continuous-valued states and actions. Fuzzy rules can be generated automatically when necessary. Fuzzy inference systems provide a natural mean of incorporating the bias components for rapid reinforcement learning. Eligibility trace method is incorporated into our algorithm, leading to faster learning and also help to alleviate the experimentation-sensitive problem that an arbitrarily bad training policy might result in poor learning. Experimental results demonstrate that the robot is able to learn the right policy with a few of trials.