Live Video Segmentation in Dynamic Backgrounds Using Thermal Vision

Authors:
Viet-Quoc Pham;Keita Takahashi;Takeshi Naemura
Affiliations:
Graduate School of Information Science and Technology, The University of Tokyo,;IRT Research Initiative, The University of Tokyo, Tokyo, Japan 113---8656;Graduate School of Information Science and Technology, The University of Tokyo,
Venue:
PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
Year:
2009

Citing 7
Cited 3

Intelligent scissors for image composition

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Thermo-Key: Human Region Segmentation from Video

IEEE Computer Graphics and Applications
"GrabCut": interactive foreground extraction using iterated graph cuts

ACM SIGGRAPH 2004 Papers
An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision

IEEE Transactions on Pattern Analysis and Machine Intelligence
Bi-Layer Segmentation of Binocular Stereo Video

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Bilayer Segmentation of Live Video

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Background cut

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II

Joint rendering and segmentation of free-viewpoint video

Journal on Image and Video Processing - Special issue on multicamera information processing: acquisition, collaboration, interpretation, and production
Time-consistent foreground segmentation of dynamic content from color and depth video

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Real-Time video matting based on bilayer segmentation

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we describe a new technique for live video segmentation of human regions from dynamic backgrounds. Correct segmentations are produced in real-time even in severe background changes caused by camera movement and illumination changes. There are three key contributions. The first contribution is the employing of the thermal cue which proves to be very effective when fused with color. Second, we propose a new speed-up GraphCut algorithm by combining with the Bayesian estimation. The third contribution is a novel online learning method using accumulative histograms. The segmentation accuracy and speed are quite capable of the live video segmentation purpose.