Eye tracking in advanced interface design
Virtual environments and advanced interface design
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Identifying fixations and saccades in eye-tracking protocols
ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
The Visual Hull Concept for Silhouette-Based Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Interactive augmented reality techniques for construction at a distance of 3D geometry
EGVE '03 Proceedings of the workshop on Virtual environments 2003
Efficient Graph-Based Image Segmentation
International Journal of Computer Vision
"GrabCut": interactive foreground extraction using iterated graph cuts
ACM SIGGRAPH 2004 Papers
3D point-of-regard, position and head orientation from a portable monocular video-based eye tracker
Proceedings of the 2008 symposium on Eye tracking research & applications
Parallel Tracking and Mapping for Small AR Workspaces
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
OutlinAR: an assisted interactive model building system with reduced computational effort
ISMAR '08 Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality
Estimating 3D point-of-regard and visualizing gaze trajectories under natural head movements
Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
Real-time dense geometry from a handheld camera
Proceedings of the 32nd DAGM conference on Pattern recognition
Eye Movement Analysis for Activity Recognition Using Electrooculography
IEEE Transactions on Pattern Analysis and Machine Intelligence
Machine learning for high-speed corner detection
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
DTAM: Dense tracking and mapping in real-time
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
GazeCloud: A Thumbnail Extraction Method Using Gaze Log Data for Video Life-Log
ISWC '12 Proceedings of the 2012 16th Annual International Symposium on Wearable Computers (ISWC)
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
IEEE Transactions on Pattern Analysis and Machine Intelligence
3D point of gaze estimation using head-mounted RGB-D cameras
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
| Hi-index | 0.00 |
This paper presents a method for estimating the 3D shape of an object being observed using wearable gaze tracking. Starting from a sparse environment map generated by a simultaneous localization and mapping algorithm (SLAM), we use the gaze direction positioned in 3D to extract the model of the object under observation. By letting the user look at the object of interest, and without any feedback, the method determines 3D point-of-regards by back-projecting the user's gaze rays into the map. The 3D point-of-regards are then used as seed points for segmenting the object from captured images and the calculated silhouettes are used to estimate the 3D shape of the object. We explore methods to remove outlier gaze points that result from the user saccading to non object points and methods for reducing the error in the shape estimation. Being able to exploit gaze information in this way, enables the user of wearable gaze trackers to be able to do things as complex as object modelling in a hands-free and even feedback-free manner.