Plenoptic modeling: an image-based rendering system
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
ACM SIGGRAPH 2003 Papers
What Energy Functions Can Be Minimizedvia Graph Cuts?
IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Graph-Based Image Segmentation
International Journal of Computer Vision
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Consistent Segmentation for Optical Flow Estimation
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Photo tourism: exploring photo collections in 3D
ACM SIGGRAPH 2006 Papers
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Poisson surface reconstruction
SGP '06 Proceedings of the fourth Eurographics symposium on Geometry processing
Stereo for Image-Based Rendering using Image Over-Segmentation
International Journal of Computer Vision
Recovering Surface Layout from an Image
International Journal of Computer Vision
Detailed Real-Time Urban 3D Reconstruction from Video
International Journal of Computer Vision
Algorithm 887: CHOLMOD, Supernodal Sparse Cholesky Factorization and Update/Downdate
ACM Transactions on Mathematical Software (TOMS)
PatchMatch: a randomized correspondence algorithm for structural image editing
ACM SIGGRAPH 2009 papers
Moving gradients: a path-based method for plausible image interpolation
ACM SIGGRAPH 2009 papers
Content-preserving warps for 3D video stabilization
ACM SIGGRAPH 2009 papers
Multi-view Superpixel Stereo in Urban Environments
International Journal of Computer Vision
Ambient point clouds for view interpolation
ACM SIGGRAPH 2010 papers
Accurate, Dense, and Robust Multiview Stereopsis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Perception-motivated interpolation of image sequences
ACM Transactions on Applied Perception (TAP)
Fusion of depth maps with multiple scales
Proceedings of the 2011 SIGGRAPH Asia Conference
Image-based rendering for scenes with reflections
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Object stereo -- Joint stereo matching and object segmentation
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Dense disparity maps from sparse disparity measurements
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
IEEE Transactions on Pattern Analysis and Machine Intelligence
Silhouette-aware warping for image-based rendering
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
Perception of visual artifacts in image-based rendering of façades
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
Multiple view object cosegmentation using appearance and stereo cues
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
Image-based rendering in the gradient domain
ACM Transactions on Graphics (TOG)
Hi-index | 0.00 |
Modern camera calibration and multiview stereo techniques enable users to smoothly navigate between different views of a scene captured using standard cameras. The underlying automatic 3D reconstruction methods work well for buildings and regular structures but often fail on vegetation, vehicles, and other complex geometry present in everyday urban scenes. Consequently, missing depth information makes Image-Based Rendering (IBR) for such scenes very challenging. Our goal is to provide plausible free-viewpoint navigation for such datasets. To do this, we introduce a new IBR algorithm that is robust to missing or unreliable geometry, providing plausible novel views even in regions quite far from the input camera positions. We first oversegment the input images, creating superpixels of homogeneous color content which often tends to preserve depth discontinuities. We then introduce a depth synthesis approach for poorly reconstructed regions based on a graph structure on the oversegmentation and appropriate traversal of the graph. The superpixels augmented with synthesized depth allow us to define a local shape-preserving warp which compensates for inaccurate depth. Our rendering algorithm blends the warped images, and generates plausible image-based novel views for our challenging target scenes. Our results demonstrate novel view synthesis in real time for multiple challenging scenes with significant depth complexity, providing a convincing immersive navigation experience.