Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking

Authors:
Amit Bleiweiss;Michael Werman
Affiliations:
School of Computer Science, The Hebrew University of Jerusalem, Jerusalem, Israel 91904;School of Computer Science, The Hebrew University of Jerusalem, Jerusalem, Israel 91904
Venue:
Dyn3D '09 Proceedings of the DAGM 2009 Workshop on Dynamic 3D Imaging
Year:
2009

Citing 6
Cited 7

Mean Shift: A Robust Approach Toward Feature Space Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Object Recognition from Local Scale-Invariant Features

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
A General Framework for Combining Visual Trackers --- The "Black Boxes" Approach

International Journal of Computer Vision
Noise Estimation from a Single Image

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
A gentle introduction to bilateral filtering and its applications

ACM SIGGRAPH 2007 courses
Speeded-Up Robust Features (SURF)

Computer Vision and Image Understanding

Channel coding for joint colour and depth segmentation

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Robust depth camera based eye localization for human-machine interactions

KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part I
A modular framework for 2d/3d and multi-modal segmentation with joint super-resolution

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
Robust object tracking in crowd dynamic scenes using explicit stereo depth

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Human localization at home using kinect

Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Region based foreground segmentation combining color and depth sensors via logarithmic opinion pool decision

Journal of Visual Communication and Image Representation
Multi-modal time-of-flight based fire detection

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an improved framework for real-time segmentation and tracking by fusing depth and RGB color data. We are able to solve common problems seen in tracking and segmentation of RGB images, such as occlusions, fast motion, and objects of similar color. Our proposed real-time mean shift based algorithm outperforms the current state of the art and is significantly better in difficult scenarios.