Spatio-temporally Consistent Multi-view Video Synthesis for Autostereoscopic Displays
PCM '09 Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Temporal consistent real-time stereo for intelligent vehicles
Pattern Recognition Letters
SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Interactive weathering of depth-inferred videos
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Binocular stereopsis of traditional Chinese paintings
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Recovering depth map from video with moving objects
PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part II
Depth estimation for semi-automatic 2D to 3D conversion
Proceedings of the 20th ACM international conference on Multimedia
3D multimedia signal processing
Proceedings of the 20th ACM international conference on Multimedia
3D reconstruction of dynamic scenes with multiple handheld cameras
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
2.1 depth estimation of frames in image sequences using motion occlusions
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Video enhancement leveraging high-quality depth maps
Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Consistent Binocular Depth and Scene Flow with Chained Temporal Profiles
International Journal of Computer Vision
Piecewise planar scene reconstruction and optimization for multi-view stereo
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part IV
Hi-index | 0.14 |
This paper presents a novel method for recovering consistent depth maps from a video sequence. We propose a bundle optimization framework to address the major difficulties in stereo reconstruction, such as dealing with image noise, occlusions, and outliers. Different from the typical multi-view stereo methods, our approach not only imposes the photo-consistency constraint, but also explicitly associates the geometric coherence with multiple frames in a statistical way. It thus can naturally maintain the temporal coherence of the recovered dense depth maps without over-smoothing. To make the inference tractable, we introduce an iterative optimization scheme by first initializing the disparity maps using a segmentation prior and then refining the disparities by means of bundle optimization. Instead of defining the visibility parameters, our method implicitly models the reconstruction noise as well as the probabilistic visibility. After bundle optimization, we introduce an efficient space-time fusion algorithm to further reduce the reconstruction noise. Our automatic depth recovery is evaluated using a variety of challenging video examples.