From dynamic movement primitives to associative skill memories

  • Authors:
  • Peter Pastor;Mrinal Kalakrishnan;Franziska Meier;Freek Stulp;Jonas Buchli;Evangelos Theodorou;Stefan Schaal

  • Affiliations:
  • Computer Science, Neuroscience, & Biomedical Engineering, University of Southern California, Los Angeles, CA 90089-2905, USA;Computer Science, Neuroscience, & Biomedical Engineering, University of Southern California, Los Angeles, CA 90089-2905, USA;Computer Science, Neuroscience, & Biomedical Engineering, University of Southern California, Los Angeles, CA 90089-2905, USA;Laboratory of Electronics and Computer Engineering, ENSTA-ParisTech, Paris, France;Italian Institute of Technology, Via Morego 30, 16163 Genoa, Italy;Department of Computer Science and Engineering, University of Washington, Seattle, USA;Computer Science, Neuroscience, & Biomedical Engineering, University of Southern California, Los Angeles, CA 90089-2905, USA and Autonomous Motion Department, Max-Planck-Institute for Intelligent ...

  • Venue:
  • Robotics and Autonomous Systems
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years, research on movement primitives has gained increasing popularity. The original goals of movement primitives are based on the desire to have a sufficiently rich and abstract representation for movement generation, which allows for efficient teaching, trial-and-error learning, and generalization of motor skills (Schaal 1999). Thus, motor skills in robots should be acquired in a natural dialog with humans, e.g., by imitation learning and shaping, while skill refinement and generalization should be accomplished autonomously by the robot. Such a scenario resembles the way we teach children and connects to the bigger question of how the human brain accomplishes skill learning. In this paper, we review how a particular computational approach to movement primitives, called dynamic movement primitives, can contribute to learning motor skills. We will address imitation learning, generalization, trial-and-error learning by reinforcement learning, movement recognition, and control based on movement primitives. But we also want to go beyond the standard goals of movement primitives. The stereotypical movement generation with movement primitives entails predicting of sensory events in the environment. Indeed, all the sensory events associated with a movement primitive form an associative skill memory that has the potential of forming a most powerful representation of a complete motor skill.