Probabilistic Logic Based Reinforcement Learning of Simple Embodied Behaviors in a 3D Simulation World

  • Authors:
  • Ari Heljakka;Ben Goertzel;Welter Silva;Cassio Pennachin;Andre' Senna;Izabela Goertzel

  • Affiliations:
  • Novamente LLC and heljakka@iki.fi;Novamente LLC;Novamente LLC;Novamente LLC;Novamente LLC;Novamente LLC

  • Venue:
  • Proceedings of the 2007 conference on Advances in Artificial General Intelligence: Concepts, Architectures and Algorithms: Proceedings of the AGI Workshop 2006
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Logic-based AI is often thought of as being restricted to highly abstract domains such as theorem-proving and linguistic semantics. In the Novamente AGI architecture, however, probabilistic logic is used for a wider variety of purposes, including simple reinforcement learning of infantile behaviors, which are primarily concerned with perception and action rather than abstract cognition. This paper reports some simple experiments designed to validate the viability of this approach, via using the PLN probabilistic logic framework, implemented within the Novamente AGI architecture, to carry out reinforcement learning of simple embodied behaviors in a 3D simulation world (AGISim). The specific experiment focused upon involves teaching Novamente to play the game of “fetch” using reinforcement learning based on repeated partial rewards. Novamente is an integrative AGI architecture involving considerably more than just PLN; however, in this “fetch” experiment, the only cognitive process PLN is coupled with is simple perceptual pattern mining; other Novamente cognitive processes such as evolutionary learning and economic attention allocation are not utilized, so as to allow the study and demonstration of the power of PLN on its own.