A Comparative Study of Value Systems for Self-Motivated Exploration and Learning by Robots

  • Authors:
  • K. E. Merrick

  • Affiliations:
  • Univ. of New South Wales at ADFA, Canberra, ACT, Australia

  • Venue:
  • IEEE Transactions on Autonomous Mental Development
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

A range of different value systems have been proposed for self-motivated agents, including biologically and cognitively inspired approaches. Likewise, these value systems have been integrated with different behavioral systems including reflexive architectures, reward-based learning and supervised learning. However, there is little literature comparing the performance of different value systems for motivating exploration and learning by robots. This paper proposes a neural network architecture for integrating different value systems with reinforcement learning. It then presents an empirical evaluation and comparison of four value systems for motivating exploration by a Lego Mindstorms NXT robot. Results reveal the different exploratory properties of novelty-seeking motivation, interest and competence-seeking motivation.