Incremental skill acquisition for self-motivated learning animats

  • Authors:
  • Andrea Bonarini;Alessandro Lazaric;Marcello Restelli

  • Affiliations:
  • Department of Electronics and Informatics, Politecnico di Milano, Milan, Italy;Department of Electronics and Informatics, Politecnico di Milano, Milan, Italy;Department of Electronics and Informatics, Politecnico di Milano, Milan, Italy

  • Venue:
  • SAB'06 Proceedings of the 9th international conference on From Animals to Animats: simulation of Adaptive Behavior
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

A central role in the development process of children is played by self-exploratory activities Through a playful interaction with the surrounding environment, they test their own capabilities, explore novel situations, and understand how their actions affect the world During this kind of exploration, interesting situations may be discovered By learning to reach these situations, a child incrementally develops more and more complex skills Inspired by studies from psychology, neuroscience, and machine learning, we designed SMILe (Self-Motivated Incremental Learning), a learning framework that allows artificial agents to autonomously identify and learn a set of abilities useful to face several different tasks, through an iterated three phase process: by means of a random exploration of the environment (babbling phase), the agent identifies interesting situations and generates an intrinsic motivation (motivating phase) aimed at learning how to get into these situations (skill acquisition phase) This process incrementally increases the skills of the agent, so that new interesting configurations can be experienced We present results on two gridworld environments to show how SMILe makes it possible to learn skills that enable the agent to perform well and robustly in many different tasks.