I-COLLIDE: an interactive and exact collision detection system for large-scale environments
I3D '95 Proceedings of the 1995 symposium on Interactive 3D graphics
Stereo Matching with Transparency and Matting
International Journal of Computer Vision - 1998 Marr Prize
Photorealistic Scene Reconstruction by Voxel Coloring
International Journal of Computer Vision
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast Approximate Energy Minimization via Graph Cuts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Video matting of complex scenes
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Image-based 3D photography using opacity hulls
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
A Theory of Shape by Space Carving
International Journal of Computer Vision - Special issue on Genomic Signal Processing
Virtual View Generation for 3D Digital Video
IEEE MultiMedia
The Visual Hull Concept for Silhouette-Based Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
ECCV '00 Proceedings of the 6th European Conference on Computer Vision-Part I
Multi-camera Scene Reconstruction via Graph Cuts
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
A Maximum-Flow Formulation of the N-Camera Stereo Correspondence Problem
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Constructing Virtual Worlds Using Dense Stereo
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
What Energy Functions Can Be Minimizedvia Graph Cuts?
IEEE Transactions on Pattern Analysis and Machine Intelligence
"GrabCut": interactive foreground extraction using iterated graph cuts
ACM SIGGRAPH 2004 Papers
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision
IEEE Transactions on Pattern Analysis and Machine Intelligence
Silhouette and stereo fusion for 3D object modeling
Computer Vision and Image Understanding - Model-based and image-based 3D scene representation for interactive visalization
ACM SIGGRAPH 2005 Papers
A Performance Evaluation of Local Descriptors
IEEE Transactions on Pattern Analysis and Machine Intelligence
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Fusion of Multi-View Silhouette Cues Using a Space Occupancy Grid
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
A Comparison of Affine Region Detectors
International Journal of Computer Vision
Virtual view synthesis of people from multiple view video sequences
Graphical Models - Special issue: Vision and computer graphics
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Probabilistic Fusion of Stereo with Color and Contrast for Bilayer Segmentation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Poisson surface reconstruction
SGP '06 Proceedings of the fourth Eurographics symposium on Geometry processing
Live 3D Video in Soccer Stadium
International Journal of Computer Vision
Foundations and Trends® in Computer Graphics and Vision
A Bayesian Framework for Simultaneous Matting and 3D Reconstruction
3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
Dual-Mode Deformable Models for Free-Viewpoint Video of Sports Events
3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
Dynamic Graph Cuts for Efficient Inference in Markov Random Fields
IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Closed-Form Solution to Natural Image Matting
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Using Multiple Hypotheses to Improve Depth-Maps for Multi-View Stereo
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Objective quality assessment in free-viewpoint video production
Image Communication
Video SnapCut: robust video object cutout using localized classifiers
ACM SIGGRAPH 2009 papers
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Automatic 3D object segmentation in multiple views using volumetric graph-cuts
Image and Vision Computing
Unstructured video-based rendering: interactive exploration of casually captured videos
ACM SIGGRAPH 2010 papers
Accurate, Dense, and Robust Multiview Stereopsis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Joint 3D-reconstruction and background separation in multiple views using graph cuts
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras
IEEE Transactions on Multimedia
A survey of methods for volumetric scene reconstruction from photographs
VG'01 Proceedings of the 2001 Eurographics conference on Volume Graphics
Novel-View Synthesis of Outdoor Sport Events Using an Adaptive View-Dependent Geometry
Computer Graphics Forum
Free-viewpoint video rendering for mobile devices
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
Proceedings of the 10th European Conference on Visual Media Production
Hi-index | 0.00 |
Current state-of-the-art image-based scene reconstruction techniques are capable of generating high-fidelity 3D models when used under controlled capture conditions. However, they are often inadequate when used in more challenging environments such as sports scenes with moving cameras. Algorithms must be able to cope with relatively large calibration and segmentation errors as well as input images separated by a wide-baseline and possibly captured at different resolutions. In this paper, we propose a technique which, under these challenging conditions, is able to efficiently compute a high-quality scene representation via graph-cut optimisation of an energy function combining multiple image cues with strong priors. Robustness is achieved by jointly optimising scene segmentation and multiple view reconstruction in a view-dependent manner with respect to each input camera. Joint optimisation prevents propagation of errors from segmentation to reconstruction as is often the case with sequential approaches. View-dependent processing increases tolerance to errors in through-the-lens calibration compared to global approaches. We evaluate our technique in the case of challenging outdoor sports scenes captured with manually operated broadcast cameras as well as several indoor scenes with natural background. A comprehensive experimental evaluation including qualitative and quantitative results demonstrates the accuracy of the technique for high quality segmentation and reconstruction and its suitability for free-viewpoint video under these difficult conditions.