Real-Time video matting based on bilayer segmentation

Authors:
Viet-Quoc Pham;Keita Takahashi;Takeshi Naemura
Affiliations:
Graduate School of Information Science and Technology, The University of Tokyo;IRT Research Initiative, The University of Tokyo, Tokyo, Japan;Graduate School of Information Science and Technology, The University of Tokyo
Venue:
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Year:
2009

Citing 5
Cited 2

Video matting of complex scenes

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision

IEEE Transactions on Pattern Analysis and Machine Intelligence
Bilayer Segmentation of Live Video

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
An Iterative Bayesian Approach for Digital Matting

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
Live Video Segmentation in Dynamic Backgrounds Using Thermal Vision

PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology

Foreground prediction for bilayer segmentation of videos

Pattern Recognition Letters
Automatic Real-Time Video Matting Using Time-of-Flight Camera and Multichannel Poisson Equations

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

Most current video matting methods perform off-line with a high calculation cost and require many user inputs for multiple key frames. In this paper, we present an online video matting method that runs in real-time based on bilayer segmentation. For the first step of the method, we introduce an accurate bilayer segmentation method for extracting the foreground region from the background using color likelihood propagation. For the second step, we perform alpha-matting based on the segmentation result. To enable real-time processing, we modify the conventional Bayesian matting method by using down-sampling and smart initialization, which increase the calculation speed by 5 times while maintaining the quality. Experimental results on various test sequences show the effectiveness of our method.