Fuzzy Q-Learning with the modified fuzzy ART neural network

  • Authors:
  • Hiroaki Ueda;Takeshi Naraki;Naoki Hanada;Hideaki Kimoto;Kenichi Takahashi;Tetsuhiro Miyahara

  • Affiliations:
  • (Correspd. E-mail: ueda@its.hiroshima-cu.ac.jp) Department of Intelligent Systems, Hiroshima City University, Hiroshima, 731-3194, Japan;Department of Intelligent Systems, Hiroshima City University, Hiroshima, 731-3194, Japan;Department of Intelligent Systems, Hiroshima City University, Hiroshima, 731-3194, Japan;Department of Intelligent Systems, Hiroshima City University, Hiroshima, 731-3194, Japan;Department of Intelligent Systems, Hiroshima City University, Hiroshima, 731-3194, Japan;Department of Intelligent Systems, Hiroshima City University, Hiroshima, 731-3194, Japan

  • Venue:
  • Web Intelligence and Agent Systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a method to acquire rules for agent behavior, where continuous numeric percepts are classified into categories by fuzzy ART and fuzzy Q-learning is employed to acquire rules. To make fuzzy ART be fit for fuzzy Q-learning, we modify fuzzy ART such that it selects multiple categories for a percept vector and calculate their fitness values. For efficient learning, we also implement category integration that integrates two categories into one in order to reduce the number of categories. Moreover, we modify the choice function to be fit for our modified fuzzy ART and also modify the timing of category integration for efficient learning. Experimental results show that our method acquires good rules for agent behavior more efficiently than Q-learning with fuzzy ART.