Teaching a Pet Robot through Virtual Games

  • Authors:
  • Anja Austermann;Seiji Yamada

  • Affiliations:
  • The Graduate University for Advanced Studies, Sokendai,;The Graduate University for Advanced Studies, Sokendai, and National Institute of Informatics, , Tokyo, Japan 101-8430

  • Venue:
  • IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a human-robot teaching framework that uses "virtual" games as a means for adapting a robot to its user through natural interaction in a controlled environment. We present an experimental study in which participants instruct an AIBO pet robot while playing different games together on a computer generated playfield. By playing the games in cooperation with its user, the robot learns to understand the user's natural way of giving multimodal positive and negative feedback. The games are designed in a way that the robot can reliably anticipate positive or negative feedback based on the game state and freely explore its user's reward behavior by making good or bad moves. We implemented a two-staged learning method combining Hidden Markov Models and a mathematical model of classical conditioning to learn how to discriminate between positive and negative feedback. After finishing the training the system was able to recognize positive and negative reward based on speech and touch with an average accuracy of 90.33%.