Single Lens Stereo with a Plenoptic Camera
IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Photorealistic Scene Reconstruction by Voxel Coloring
International Journal of Computer Vision
Surface light fields for 3D photography
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Dynamically reparameterized light fields
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A compact algorithm for rectification of stereo pairs
Machine Vision and Applications
Depth from Defocus vs. Stereo: How Different Really Are They?
International Journal of Computer Vision - Special issue on computer vision research at the Technion
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Mean Shift: A Robust Approach Toward Feature Space Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Light field mapping: efficient representation and hardware rendering of surface light fields
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
International Journal of Computer Vision
Extracting Objects from Range and Radiance Images
IEEE Transactions on Visualization and Computer Graphics
Symmetric Sub-Pixel Stereo Matching
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Pattern Classification (2nd Edition)
Pattern Classification (2nd Edition)
Extracting View-Dependent Depth Maps from a Collection of Images
International Journal of Computer Vision - Special Issue on Research at Microsoft Corporation
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Mosaicing with Parallax using Time Warping
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 11 - Volume 11
Extracting layers and analyzing their specular properties using epipolar-plane-image analysis
Computer Vision and Image Understanding
Image-Based Rendering Using Image-Based Priors
International Journal of Computer Vision
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Global Depth from Epipolar Volumes--A General Framework for Reconstructing Non-Lambertian Surfaces
3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Stereo for Image-Based Rendering using Image Over-Segmentation
International Journal of Computer Vision
Programmable aperture photography: multiplexed light field acquisition
ACM SIGGRAPH 2008 papers
Modeling the World from Internet Photo Collections
International Journal of Computer Vision
High-quality single-shot capture of facial geometry
ACM SIGGRAPH 2010 papers
Accurate, Dense, and Robust Multiview Stereopsis
IEEE Transactions on Pattern Analysis and Machine Intelligence
The application of vision algorithms to visual effects production
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
Joint 3D-reconstruction and background separation in multiple views using graph cuts
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Full-resolution depth map estimation from an aliased plenoptic light field
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Stereo Matching with Reliable Disparity Propagation
3DIMPVT '11 Proceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission
Generating EPI representations of 4D Light fields with a single lens focused plenoptic camera
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Learning to find occlusion regions
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Fast cost-volume filtering for visual correspondence and beyond
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Object stereo -- Joint stereo matching and object segmentation
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Sparse Occlusion Detection with Optical Flow
International Journal of Computer Vision
Computer Graphics Forum
A self-reconfigurable camera array
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Content-adaptive lenticular prints
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
| Hi-index | 0.00 |
This paper describes a method for scene reconstruction of complex, detailed environments from 3D light fields. Densely sampled light fields in the order of 109 light rays allow us to capture the real world in unparalleled detail, but efficiently processing this amount of data to generate an equally detailed reconstruction represents a significant challenge to existing algorithms. We propose an algorithm that leverages coherence in massive light fields by breaking with a number of established practices in image-based reconstruction. Our algorithm first computes reliable depth estimates specifically around object boundaries instead of interior regions, by operating on individual light rays instead of image patches. More homogeneous interior regions are then processed in a fine-to-coarse procedure rather than the standard coarse-to-fine approaches. At no point in our method is any form of global optimization performed. This allows our algorithm to retain precise object contours while still ensuring smooth reconstructions in less detailed areas. While the core reconstruction method handles general unstructured input, we also introduce a sparse representation and a propagation scheme for reliable depth estimates which make our algorithm particularly effective for 3D input, enabling fast and memory efficient processing of "Gigaray light fields" on a standard GPU. We show dense 3D reconstructions of highly detailed scenes, enabling applications such as automatic segmentation and image-based rendering, and provide an extensive evaluation and comparison to existing image-based reconstruction techniques.