Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach

  • Authors:
  • Luka Peternel;Tadej Petrič;Erhan Oztop;Jan Babič

  • Affiliations:
  • Department of Automation, Biocybernetics and Robotics, Jožef Stefan Institute, Jamova cesta 39, Ljubljana, Slovenia 1000;Department of Automation, Biocybernetics and Robotics, Jožef Stefan Institute, Jamova cesta 39, Ljubljana, Slovenia 1000;Computer Science, Özyeğin University, Alemdag, Turkey 34794;Department of Automation, Biocybernetics and Robotics, Jožef Stefan Institute, Jamova cesta 39, Ljubljana, Slovenia 1000

  • Venue:
  • Autonomous Robots
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose an approach to efficiently teach robots how to perform dynamic manipulation tasks in cooperation with a human partner. The approach utilises human sensorimotor learning ability where the human tutor controls the robot through a multi-modal interface to make it perform the desired task. During the tutoring, the robot simultaneously learns the action policy of the tutor and through time gains full autonomy. We demonstrate our approach by an experiment where we taught a robot how to perform a wood sawing task with a human partner using a two-person cross-cut saw. The challenge of this experiment is that it requires precise coordination of the robot's motion and compliance according to the partner's actions. To transfer the sawing skill from the tutor to the robot we used Locally Weighted Regression for trajectory generalisation, and adaptive oscillators for adaptation of the robot to the partner's motion.