Emotion-based intrinsic motivation for reinforcement learning agents

  • Authors:
  • Pedro Sequeira;Francisco S. Melo;Ana Paiva

  • Affiliations:
  • Instituto Superior Técnico, Universidade Técnica de Lisboa, INESC-ID, Porto Salvo, Portugal;Instituto Superior Técnico, Universidade Técnica de Lisboa, INESC-ID, Porto Salvo, Portugal;Instituto Superior Técnico, Universidade Técnica de Lisboa, INESC-ID, Porto Salvo, Portugal

  • Venue:
  • ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose an adaptation of four common appraisal dimensions that evaluate the relation of an agent with its environment into reward features within an intrinsically motivated reinforcement learning framework. We show that, by optimizing the relative weights of such features for a given environment, the agents attain a greater degree of fitness while overcoming some of their perceptual limitations. This optimization process resembles the evolutionary adaptive process that living organisms are subject to. We illustrate the application of our method in several simulated foraging scenarios.