Rendering fur with three dimensional textures
SIGGRAPH '89 Proceedings of the 16th annual conference on Computer graphics and interactive techniques
A model for anisotropic reflection
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Integration of interpersonal space and shared workspace: ClearBoard design and experiments
ACM Transactions on Information Systems (TOIS)
Teleconferencing eye contract using a virtual camera
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
The GAZE groupware system: mediating joint attention in multiparty communication and collaboration
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
A simple and efficient error-diffusion algorithm
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Leveraging the asymmetric sensitivity of eye contact for videoconference
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Eye gaze correction for videoconferencing
ETRA '02 Proceedings of the 2002 symposium on Eye tracking research & applications
A real-time distributed light field camera
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
MagicMouse: an inexpensive 6-degree-of-freedom mouse
Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Gaze Awareness for Video-Conferencing: A Software Approach
IEEE MultiMedia
blue-c: a spatially immersive display and 3D video portal for telepresence
ACM SIGGRAPH 2003 Papers
Are you looking at me? Eye contact and desktop video conferencing
ACM Transactions on Computer-Human Interaction (TOCHI)
Robust Real-Time Face Detection
International Journal of Computer Vision
Eye Gaze Correction with Stereovision for Video-Teleconferencing
IEEE Transactions on Pattern Analysis and Machine Intelligence
MultiView: spatially faithful group video conferencing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
What is connected by mutual gaze?: user's behavior in video-mediated communication
CHI '05 Extended Abstracts on Human Factors in Computing Systems
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
The VarrierTM autostereoscopic virtual reality display
ACM SIGGRAPH 2005 Papers
Fast separation of direct and global components of a scene using high frequency illumination
ACM SIGGRAPH 2006 Papers
Multiview: improving trust in group video conferencing through spatial faithfulness
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Rendering for an interactive 360° light field display
ACM SIGGRAPH 2007 papers
Remote conversations: the effects of mediating talk with technology
Human-Computer Interaction
IEEE Transactions on Visualization and Computer Graphics
Antialiasing for automultiscopic 3D displays
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology
C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments
Proceedings of the 2011 SIGGRAPH Asia Conference
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SphereAvatar: a situated display to represent a remote collaborator
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gaze correction for home video conferencing
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
The extended window metaphor for large high-resolution displays
EGVE - JVRC'10 Proceedings of the 16th Eurographics conference on Virtual Environments & Second Joint Virtual Reality
MulDiRoH: a human representation system with multi-view display using a QDA screen
SIGGRAPH Asia 2012 Posters
A low-latency 3D teleconferencing system with image based approach
Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
| Hi-index | 0.00 |
We present a set of algorithms and an associated display system capable of producing correctly rendered eye contact between a three-dimensionally transmitted remote participant and a group of observers in a 3D teleconferencing system. The participant's face is scanned in 3D at 30Hz and transmitted in real time to an autostereoscopic horizontal-parallax 3D display, displaying him or her over more than a 180° field of view observable to multiple observers. To render the geometry with correct perspective, we create a fast vertex shader based on a 6D lookup table for projecting 3D scene vertices to a range of subject angles, heights, and distances. We generalize the projection mathematics to arbitrarily shaped display surfaces, which allows us to employ a curved concave display surface to focus the high speed imagery to individual observers. To achieve two-way eye contact, we capture 2D video from a cross-polarized camera reflected to the position of the virtual participant's eyes, and display this 2D video feed on a large screen in front of the real participant, replicating the viewpoint of their virtual self. To achieve correct vertical perspective, we further leverage this image to track the position of each audience member's eyes, allowing the 3D display to render correct vertical perspective for each of the viewers around the device. The result is a one-to-many 3D teleconferencing system able to reproduce the effects of gaze, attention, and eye contact generally missing in traditional teleconferencing systems.