What video can and can't do for collaboration: a case study
MULTIMEDIA '93 Proceedings of the first ACM international conference on Multimedia
Three-dimensional computer vision: a geometric viewpoint
Three-dimensional computer vision: a geometric viewpoint
Plenoptic modeling: an image-based rendering system
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Beating the limitations of camera-monitor mediated telepresence with extra eyes
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Rendering with concentric mosaics
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Multi-projector displays using camera-based registration
VIS '99 Proceedings of the conference on Visualization '99: celebrating ten years
Dynamically reparameterized light fields
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Online model reconstruction for interactive virtual environments
I3D '01 Proceedings of the 2001 symposium on Interactive 3D graphics
The impact of eye gaze on communication using humanoid avatars
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Toward a compelling sensation of telepresence: demonstrating a portal to a distant (static) office
Proceedings of the conference on Visualization '00
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Technical system for collaborative work
EGVE '02 Proceedings of the workshop on Virtual environments 2002
An immersive 3D video-conferencing system using shared virtual team user environments
Proceedings of the 4th international conference on Collaborative virtual environments
A real-time distributed light field camera
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
First steps towards mutually-immersive mobile telepresence
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
International Journal of Computer Vision
Trinocular Stereo: A Real-Time Algorithm and its Evaluation
International Journal of Computer Vision
Real-Time Correlation-Based Stereo Vision with Reduced Border Errors
International Journal of Computer Vision
The Visual Hull Concept for Silhouette-Based Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Eye Gaze Correction with Stereovision for Video-Teleconferencing
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator
FCRC '96/WACG '96 Selected papers from the Workshop on Applied Computational Geormetry, Towards Geometric Engineering
A Stereo Machine for Video-Rate Dense Depth Mapping and Its New Applications
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Real-time stereo vision on the PARTS reconfigurable computer
FCCM '97 Proceedings of the 5th IEEE Symposium on FPGA-Based Custom Computing Machines
Free-viewpoint video of human actors
ACM SIGGRAPH 2003 Papers
blue-c: a spatially immersive display and 3D video portal for telepresence
ACM SIGGRAPH 2003 Papers
Improvements in Real-Time Correlation-Based Stereo Vision
SMBV '01 Proceedings of the IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV'01)
Gaze Manipulation for One-to-one Teleconferencing
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
An Augmented Virtuality Approach to 3D Videoconferencing
ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Computation and performance issues In coliseum: an immersive videoconferencing system
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Fast image segmentation and smoothing using commodity graphics hardware
Journal of Graphics Tools - Special on hardware-accelerated rendering techniques
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Improved Real-Time Stereo on Commodity Graphics Hardware
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 3 - Volume 03
Towards space: time light field rendering
Proceedings of the 2005 symposium on Interactive 3D graphics and games
Symmetric Stereo Matching for Occlusion Handling
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Video-rate stereo depth measurement on programmable hardware
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
A self-reconfigurable camera array
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Evaluation of theora and speex performance in IP videoconferencing
Proceedings of the 18th Brazilian symposium on Multimedia and the web
| Hi-index | 0.00 |
Existing video teleconferencing techniques suffer from limited field of view, low resolution, and fixed viewpoint. We present a set of novel techniques to overcome these limitations. Based on the light field rendering concept, we utilize an array of cameras to capture the participant(s) from multiple view angles. Based on either assumed or estimated scene geometry, these images are assembled to create a high-resolution seamless image from a user-controllable viewpoint. Two different camera configurations, one dense and one sparse, are presented; the dense format is optimized for high-fidelity view synthesis while the sparse configuration is for expanded viewing volume. For the dense configuration, we provide a detailed analysis on the number of camera images required. For the sparse configuration, we present a robust technique to estimate an approximation of the scene geometry to provide smooth transition when the viewpoint is changed. The novelty of our approach is that it allows the users to electronically steer the viewpoint in real time for a live scene. Therefore it can be used in 3D teleconferencing systems to generate stereoscopic views, or in group teleconferencing to provide virtual camera views that minimize the overall perspective distortions. We demonstrate the effectiveness of our approach with a point-to-point teleconferencing system distributed in several locations across the continental United States.