Improved video segmentation by adaptive combination of depth keying and mixture-of-gaussians

Authors:
Ingo Schiller;Reinhard Koch
Affiliations:
Multimedia Information Processing, Institute of Computer Science, University of Kiel, Germany;Multimedia Information Processing, Institute of Computer Science, University of Kiel, Germany
Venue:
SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Year:
2011

Citing 3
Cited 2

Blue screen matting

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Image and video matting: a survey

Foundations and Trends® in Computer Graphics and Vision
Real-time video matting using multichannel poisson equations

Proceedings of Graphics Interface 2010

Region based foreground segmentation combining color and depth sensors via logarithmic opinion pool decision

Journal of Visual Communication and Image Representation
Automatic objects segmentation with RGB-D cameras

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Video segmentation or matting, the separation of foreground objects from background in video sequences, is a demanding task and is needed for a broad range of applications. The most widespread method for video segmentation is chroma-keying using a known background color for which a controlled environment is required. Recently a different method of keying fore-and background has been proposed in which the chroma-keying is replaced by depth-keying using a Time-of-Flight (ToF) camera. The current ToF-cameras suffer from noise and low resolution sensors, which results in unsatisfying segmentation results. We propose to combine the segmentation of dynamic objects in depth with a segmentation in the color domain using adaptive background models. We weight the two measures depending on the actual depth values using either the variance of the depth images of the ToF-camera or the amplitude image of the ToF-camera as reliability measure. We show that both methods significantly improve the segmentation results.