Knowledge Driven Planning and Multimodal Control of a Telerobot

  • Authors:
  • Zunaid Kazi;Richard Foulds

  • Affiliations:
  • Applied Science and Engineering Laboratories, duPont Hospital for Children and the University of Delaware, P.O. Box 269, Wilmington DE 19899, USA. http://www.asel.udel.edu/rob ...;Applied Science and Engineering Laboratories, duPont Hospital for Children and the University of Delaware, P.O. Box 269, Wilmington DE 19899, USA. http://www.asel.udel.edu/rob ...

  • Venue:
  • Robotica
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Multimodal User Supervised Interface and Intelligent Control (MUSIIC) project focuses on a multimodal human-machine interface which addresses user need to manipulate familiar objects in an unstructured environment. The control of a robot by individuals with significant physical limitations presents a challenging problem of telemanipulation. This is addressed by a unique user-interface integrating the user's command (speech) and gestures (pointing) with autonomous planning techniques (knowledge-bases and 3-D vision). The resultant test-bed offers the opportunity to study telemanipulation by individuals with physical disabilities, and can be generalized to an effective technique for other, including remote and time-delayed, telemanipulation. This paper focuses on the knowledge-driven planning mechanism that is central to the MUSIIC system.