Three-dimensional computer vision: a geometric viewpoint
Three-dimensional computer vision: a geometric viewpoint
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Teleconferencing eye contract using a virtual camera
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes
International Journal of Computer Vision
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Gaze Awareness for Video-Conferencing: A Software Approach
IEEE MultiMedia
A Progressive Scheme for Stereo Matching
SMILE '00 Revised Papers from Second European Workshop on 3D Structure from Multiple Images of Large-Scale Environments
Computing 3-D head orientation from a monocular image sequence
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Motion Regularization for Model-Based Head Tracking
ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Dynamic Programming
Eye Gaze Correction with Stereovision for Video-Teleconferencing
IEEE Transactions on Pattern Analysis and Machine Intelligence
A non-contact device for tracking gaze in a human computer interface
Computer Vision and Image Understanding - Special issue on eye detection and tracking
Efficient Dense Stereo with Occlusions for New View-Synthesis by Four-State Dynamic Programming
International Journal of Computer Vision
Immersive Video Teleconferencing with User-Steerable Views
Presence: Teleoperators and Virtual Environments
Implementing three-party desktop videoconferencing
OZCHI '07 Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces
Multi-baseline disparity fusion for immersive videoconferencing
Proceedings of the 2nd International Conference on Immersive Telecommunications
A non-contact device for tracking gaze in a human computer interface
Computer Vision and Image Understanding - Special issue on eye detection and tracking
Iris tracking and regeneration for improving nonverbal interface
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Gaze correction for home video conferencing
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Towards more engaging telepresence by face tracking
Proceedings of the Workshop at SIGGRAPH Asia
Hi-index | 0.00 |
The lack of eye contact in desktop video teleconferencing substantially reduces the effectiveness of video contents. While expensive and bulky hardware is available on the market to correct eye gaze, researchers have been trying to provide a practical software-based solution to bring video-teleconferencing one step closer to the mass market. This paper presents a novel approach that is based on stereo analysis combined with rich domain knowledge (a personalized face model). This marriage is mutually beneficial. The personalized face model greatly improved the accuracy and robustness of the stereo analysis by substantially reducing the search range; the stereo techniques, using both feature matching and template matching, allow us to extract 3D information of objects other than the face and to determine the head pose in a much more reliable way than if only one camera is used. Thus we enjoy the versatility of stereo techniques without suffering from their vulnerability. By emphasizing a 3D description of the scene on the face part, we synthesize virtual views that maintain eye contact using graphics hardware. Our current system is able to generate an eye-gaze corrected video stream at about 5 frames per second on a commodity PC.