Multi-modal object of interest detection using eye gaze and RGB-D cameras

Authors:
Christopher McMurrough;Jonathan Rich;Christopher Conly;Vassilis Athitsos;Fillia Makedon
Affiliations:
The University of Texas at Arlington, Arlington, Texas;The University of Texas at Arlington, Arlington, Texas;The University of Texas at Arlington, Arlington, Texas;The University of Texas at Arlington, Arlington, Texas;The University of Texas at Arlington, Arlington, Texas
Venue:
Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
Year:
2012

Citing 7
Cited 0

Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - Volume 03
openEyes: a low-cost head-mounted eye-tracking solution

Proceedings of the 2006 symposium on Eye tracking research & applications
Speeded-Up Robust Features (SURF)

Computer Vision and Image Understanding
Low-cost gaze interaction: ready to deliver the promises

CHI '09 Extended Abstracts on Human Factors in Computing Systems
Estimating 3D point-of-regard and visualizing gaze trajectories under natural head movements

Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
A general method for the point of regard estimation in 3D space

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a low-cost, wearable headset for mobile 3D Point of Gaze (PoG) estimation in assistive applications. The device consists of an eye tracking camera and forward facing RGB-D scene camera which are able to provide an estimate of the user gaze vector and its intersection with a 3D point in space. A computational approach that considers object 3D information and visual appearance together with the visual gaze interactions of the user is also given to demonstrate the utility of the device. The resulting system is able to identify, in real-time, known objects within a scene that intersect with the user gaze vector.