Learning to Recognize and Grasp Objects

  • Authors:
  • Josef Pauli

  • Affiliations:
  • Christian-Albrechts-Universität, Institut für Informatik, Preusserstrasse 1-9, D-24105 Kiel, Germany. E-mail: jpa@informatik.uni-kiel.de

  • Venue:
  • Autonomous Robots
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

We apply techniques of computer vision and neural networklearning to get a versatile robot manipulator. All work conductedfollows the principle of autonomous learning from visualdemonstration. The user must demonstrate the relevant objects,situations, and/or actions, and the robot vision system must learnfrom those. For approaching and grasping technical objects threeprincipal tasks have to be done—calibrating the camera-robotcoordination, detecting the desired object in the images, andchoosing a stable grasping pose. These procedures are based on(nonlinear) functions, which are not known a priori and thereforehave to be learned. We uniformly approximate the necessary functionsby networks of gaussian basis functions (GBF networks). By modifyingthe number of basis functions and/or the size of the gaussian supportthe quality of the function approximation changes. The appropriateconfiguration is learned in the training phase and applied during theoperation phase. All experiments are carried out in real worldapplications using an industrial articulation robot manipulator andthe computer vision system KHOROS.