Multi-modal interfaces for control of assistive robotic devices

Authors:
Christopher Dale McMurrough
Affiliations:
The University of Texas at Arlington, Arlington, TX, USA
Venue:
Proceedings of the 14th ACM international conference on Multimodal interaction
Year:
2012

Citing 9
Cited 0

Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - Volume 03
openEyes: a low-cost head-mounted eye-tracking solution

Proceedings of the 2006 symposium on Eye tracking research & applications
Low-cost gaze interaction: ready to deliver the promises

CHI '09 Extended Abstracts on Human Factors in Computing Systems
Estimating 3D point-of-regard and visualizing gaze trajectories under natural head movements

Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
eyeDog: an assistive-guide robot for the visually impaired

Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments
An eye tracking dataset for point of gaze detection

Proceedings of the Symposium on Eye Tracking Research and Applications
A general method for the point of regard estimation in 3D space

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
A survey of assistive devices for cerebral palsy patients

Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments
Low-cost head position tracking for gaze point estimation

Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an outline of dissertation research activities which aim to advance the use of non-traditional, multimodal interfaces in assistive robotic devices. The data modalities which are of particular interest in the work are perception of the environment using 3D scanning and computer vision, estimation of the user point of gaze, and perception of user intent during interaction with objects of interest. The main goal of this research is to explore the hypothesis that the combination of these data modalities can be used to provide intuitive and effective means of control over existing robotic platforms, such as wheelchairs and manipulators, to users with severe physical impairments.