Application of Markerless Image-Based Arm Tracking to Robot-Manipulator Teleoperation

  • Authors:
  • Affiliations:
  • Venue:
  • CRV '04 Proceedings of the 1st Canadian Conference on Computer and Robot Vision
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

In robot teleoperation, contacting mechanicaldevices and sensors have been commonly used to trackoperator hand and arm motion. While camera-basedtracking has the benefit of being non-contacting,markerless camera-based human tracking offers afurther advantage of not requiring markers and thusavoiding marker occlusion. This paper presents anapplication of markerless image-based arm trackingto real-time teleoperation of a robot manipulator. Themarkerless tracking is carried out by processingimages from two calibrated cameras in real-time, toestimate the positions of the joint centres of the wristand elbow in three dimensions (3D), and to computethe 3D positions of the index finger and thumb inorder to estimate the hand orientation. These are usedto determine the position and orientation of the end-effectorof a robot-manipulator in real-timeteleoperation. Markerless tracking for teleoperationwas demonstrated for pick-and-place tasks.