SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Environment matting and compositing
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A Theory of Single-Viewpoint Catadioptric Image Formation
International Journal of Computer Vision
Catadioptric Projective Geometry
International Journal of Computer Vision
Eye Gaze Estimation from a Single Image of One Eye
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Face recognition: A literature survey
ACM Computing Surveys (CSUR)
Computer vision in the interface
Communications of the ACM - Multimodal interfaces that flex, adapt, and persist
ACM SIGGRAPH 2004 Papers
3D Acquisition of mirroring objects using striped patterns
Graphical Models
Using Eye Reflections for Face Recognition Under Varying Illumination
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Enabling View-Dependent Stereoscopic Projection in Real Environments
ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
Non-Single Viewpoint Catadioptric Cameras: Geometry and Analysis
International Journal of Computer Vision
Corneal Imaging System: Environment from Eyes
International Journal of Computer Vision
Multiview radial catadioptric imaging for scene capture
ACM SIGGRAPH 2006 Papers
Eye Tracking Methodology: Theory and Practice
Eye Tracking Methodology: Theory and Practice
Screen-Camera Calibration using a Spherical Mirror
CRV '07 Proceedings of the Fourth Canadian Conference on Computer and Robot Vision
Using a Raster Display for Photometric Stereo
CRV '07 Proceedings of the Fourth Canadian Conference on Computer and Robot Vision
Multimodal human-computer interaction: A survey
Computer Vision and Image Understanding
A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation
International Journal of Computer Vision
Models for gaze tracking systems
Journal on Image and Video Processing
Remote point-of-gaze estimation requiring a single-point calibration for applications with infants
Proceedings of the 2008 symposium on Eye tracking research & applications
Image understanding for iris biometrics: A survey
Computer Vision and Image Understanding
A robust gaze detection method by compensating for facial movements based on corneal specularities
Pattern Recognition Letters
Separating corneal reflections for illumination estimation
Neurocomputing
Compromising Reflections-or-How to Read LCD Monitors around the Corner
SP '08 Proceedings of the 2008 IEEE Symposium on Security and Privacy
Fast Normal Map Acquisition Using an LCD Screen Emitting Gradient Patterns
CRV '08 Proceedings of the 2008 Canadian Conference on Computer and Robot Vision
A Study on Human Gaze Estimation Using Screen Reflection
IDEAL '08 Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learning
Affine double- and triple-product wavelet integrals for rendering
ACM Transactions on Graphics (TOG)
Screen-Camera Calibration Using Gray Codes
CRV '09 Proceedings of the 2009 Canadian Conference on Computer and Robot Vision
Tempest in a Teapot: Compromising Reflections Revisited
SP '09 Proceedings of the 2009 30th IEEE Symposium on Security and Privacy
Eye gaze tracking techniques for interactive applications
Computer Vision and Image Understanding - Special issue on eye detection and tracking
A novel non-intrusive eye gaze estimation using cross-ratio under large head motion
Computer Vision and Image Understanding - Special issue on eye detection and tracking
Photometric stereo using LCD displays
Image and Vision Computing
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
IEEE Transactions on Pattern Analysis and Machine Intelligence
A depth compensation method for cross-ratio based eye tracking
Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
Exposing digital forgeries through specular highlights on the eye
IH'07 Proceedings of the 9th international conference on Information hiding
Eye reflection analysis and application to display-camera calibration
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
How to compute the pose of an object without a direct view?
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
General specular surface triangulation
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
IEEE Transactions on Circuits and Systems for Video Technology
Point of gaze estimation through corneal surface reflection in an active illumination environment
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Hi-index | 0.00 |
In this paper, we describe a novel method for calibrating display-camera setups from reflections in a user's eyes. Combining both devices creates a capable controlled illumination system that enables a range of interesting vision applications in non-professional environments, including object/face reconstruction and human-computer interaction. One major issue barring such systems from average homes is the geometric calibration to obtain the pose of the display which requires special hardware and tedious user interaction. Our proposed approach eliminates this requirement by introducing the novel idea of analyzing screen reflections in the cornea of the human eye, a mirroring device that is always available. We employ a simple shape model to recover pose and reflection characteristics of the eye. Thorough experimental evaluation shows that the basic strategy results in a large error and discusses possible reasons. Based on the findings, a non-linear optimization strategy is developed that exploits geometry constraints within the system to considerably improve the initial estimate. It further allows to automatically resolve an inherent ambiguity that arises in image-based eye pose estimation. The strategy may also be integrated to improve spherical mirror calibration. We describe several comprehensive experimental studies which show that the proposed method performs stably with respect to varying subjects, display poses, eye positions, and gaze directions. The results are feasible and should be sufficient for many applications. In addition, the findings provide general insight on the application of eye reflections for geometric reconstruction.