Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera

Authors:
Guofeng Zhang;Jiaya Jia;Wei Hua;Hujun Bao
Affiliations:
Zhejiang University, Hangzhou;The Chinese University of Hong Kong, Hong Kong;Zhejiang University, Hangzhou;Zhejiang University, Hangzhou
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2011

Citing 0
Cited 7

Interactive weathering of depth-inferred videos

Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Automatic Real-Time Video Matting Using Time-of-Flight Camera and Multichannel Poisson Equations

International Journal of Computer Vision
3D reconstruction of dynamic scenes with multiple handheld cameras

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Depth extraction from video using non-parametric sampling

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
Learning object appearance from occlusions using structure and motion recovery

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Layered moving-object segmentation for stereoscopic video using motion and depth information

Journal of Visual Communication and Image Representation
Event-driven video adaptation: A powerful tool for industrial video supervision

Multimedia Tools and Applications

Quantified Score

Hi-index	0.17

Visualization

Abstract

Extracting high-quality dynamic foreground layers from a video sequence is a challenging problem due to the coupling of color, motion, and occlusion. Many approaches assume that the background scene is static or undergoes the planar perspective transformation. In this paper, we relax these restrictions and present a comprehensive system for accurately computing object motion, layer, and depth information. A novel algorithm that combines different clues to extract the foreground layer is proposed, where a voting-like scheme robust to outliers is employed in optimization. The system is capable of handling difficult examples in which the background is nonplanar and the camera freely moves during video capturing. Our work finds several applications, such as high-quality view interpolation and video editing.