Fuzzy Q-learning in a nondeterministic environment: developing an intelligent Ms. Pac-Man agent

  • Authors:
  • Lori L. DeLooze;Wesley R. Viner

  • Affiliations:
  • United States Naval Academy, Annapolis, MD;United States Marine Corp and United States Naval Academy, Annapolis, MD

  • Venue:
  • CIG'09 Proceedings of the 5th international conference on Computational Intelligence and Games
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper reports the results from training an intelligent agent to play the Ms. Pac-Man video game using variations of a fuzzy Q-learning algorithm. This approach allows us to address the nondeterministic aspects of the game as well as finding a successful self-learning or adaptive playing strategy. The strategy presented is a table based learning strategy, in which the intelligent agent analyzes the current situation of the game, stores various membership values for each of the several contributors to the situation (distance to closest pill, distance to closest power pill, and distance to closest ghost), and makes decisions based on these values.