A Reinforcement Learning Adaptive Fuzzy Controller for Differential Games

  • Authors:
  • Sidney N. Givigi, Jr.;Howard M. Schwartz;Xiaosong Lu

  • Affiliations:
  • Department of Electrical and Computer Engineering, Royal Military College of Canada, Kingston, Canada K7K 7B4;Systems and Computer Engineering, Carleton University, Ottawa, Canada K1S 5B6;Systems and Computer Engineering, Carleton University, Ottawa, Canada K1S 5B6

  • Venue:
  • Journal of Intelligent and Robotic Systems
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we develop a reinforcement fuzzy learning scheme for robots playing a differential game. Differential games are games played in continuous time, with continuous states and actions. Fuzzy controllers are used to approximate the calculation of future reinforcements of the game due to actions taken at a specific time. If an immediate reinforcement reward function is defined, we may use a fuzzy system to tell what is the predicted reinforcement in a specified time ahead. This reinforcement is then used to adapt a fuzzy controller that stores the experience accumulated by the player. Simulations of a modified two car game are provided in order to show the potentiality of the technique. Experiments are performed in order to validate the method. Finally, it should be noted that although the game used as an example involves only two players, the technique may also be used in a multi-game environment.