Eye-in-hand stereo visual servoing of an assistive robot arm in unstructured environments

Authors:
Dae-Jin Kim;Ryan Lovelett;Aman Behal
Affiliations:
NanoScience Technology Center, University of Central Florida, Orlando, FL;School of EECS, University of Central Florida, Orlando, FL;School of EECS and NanoScience Technology Center, University of Central Florida, Orlando, FL
Venue:
ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Year:
2009

Citing 4
Cited 2

Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Scalable Recognition with a Vocabulary Tree

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Learning grasp strategies with partial shape information

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3

Optimal independent contact regions for two-fingered grasping of polygon

Robotica
“I want that”: Human-in-the-loop control of a wheelchair-mounted robotic arm

Applied Bionics and Biomechanics - Assistive and Rehabilitation Robotics

Quantified Score

Hi-index	0.00

Visualization

Abstract

We document the progress in the design and implementation of a motion control strategy that exploits visual feedback from a narrow baseline stereo head mounted in the hand of a wheelchair mounted robot arm (WMRA) to recognize and grasp textured ADL objects for which one or more templates exist in a large image database. The problem is made challenging by kinematic uncertainty in the robot, imperfect camera and stereo calibration, as well as the fact that we work in unstructured environments. The approach relies on separating the overall motion into gross and fine motion components. During the gross motion phase, local structure on an object around a user selected point of interest (POI) is extracted using sparse stereo information which is then utilized to converge on and roughly align the object with the image plane in order to be able to pursue object recognition and fine motion with strong likelihood of success. Fine motion is utilized to grasp the target object by relying on feature correspondences between the live object view and its template image. While features are detected using a robust real-time keypoint tracker, a hybrid visual servoing technique is exploited in which tracked pixel space features are utilized to generate translational motion commands while a Euclidean homography decomposition scheme is utilized for generation of orientation setpoints for the robot gripper. Experimental results are presented to demonstrate the efficacy of the proposed algorithm.