Teleconferencing eye contract using a virtual camera
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes
International Journal of Computer Vision
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Gaze Awareness for Video-Conferencing: A Software Approach
IEEE MultiMedia
Eye Gaze Correction with Stereovision for Video-Teleconferencing
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Model-Based Head Pose Tracking With Stereovision
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Achieving eye contact in a one-to-many 3D video teleconferencing system
ACM SIGGRAPH 2009 papers
Bilayer representation for three dimensional visual communication
Journal of Visual Communication and Image Representation
Viewpoint interpolation using an ellipsoid head model for video teleconferencing
ISVC'05 Proceedings of the First international conference on Advances in Visual Computing
VCS: a virtual collaborative space based on immersive teleconferencing
ICAT'06 Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-Existence
Immersing tele-operators in collaborative augmented reality
ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
A novel framework for making dominant point detection methods non-parametric
Image and Vision Computing
Manipulation of an emotional experience by real-time deformed facial feedback
Proceedings of the 4th Augmented Human International Conference
| Hi-index | 0.14 |
The lack of eye contact in desktop video teleconferencing substantially reduces the effectiveness of video contents. While expensive and bulky hardware is available on the market to correct eye gaze, researchers have been trying to provide a practical software-based solution to bring video-teleconferencing one step closer to the mass market. This paper presents a novel approach: Based on stereo analysis combined with rich domain knowledge (a personalized face model), we synthesize, using graphics hardware, a virtual video that maintains eye contact. A 3D stereo head tracker with a personalized face model is used to compute initial correspondences across two views. More correspondences are then added through template and feature matching. Finally, all the correspondence information is fused together for view synthesis using view morphing techniques. The combined methods greatly enhance the accuracy and robustness of the synthesized views. Our current system is able to generate an eye-gaze corrected video stream at five frames per second on a commodity 1 GHz PC.