An ease-of-use stereo-based particle filter for tracking under occlusion

Authors:
Ser-Nam Lim;Larry Davis
Affiliations:
Cognex Corp., Natick, MA;CS Dept., University of Maryland, College Park, Maryland
Venue:
Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Year:
2007

Citing 14
Cited 0

CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Parallax Geometry of Pairs of Points for 3D Scene Analysis

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
From Reference Frames to Reference Planes: Multi-View Parallax Geometry and Applications

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
M2Tracker: A Multi-view Approach to Segmenting and Tracking People in a Cluttered Scene Using Region-Based Stereo

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Counting People in Crowds with a Real-Time Network of Simple Image Sensors

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
A Background Layer Model for Object Tracking Through Occlusion

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Real-Time Multiple Objects Tracking with Occlusion Handling in Dynamic Scenes

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Real-Time Wide Area Multi-Camera Stereo Tracking

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
A Unified Framework for Tracking through Occlusions and across Sensor Gaps

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Counting Crowded Moving Objects

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
An iterative image registration technique with an application to stereo vision

IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2
A multiview approach to tracking people in crowded scenes using a planar homography constraint

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Multi-camera tracking and segmentation of occluded people on ground plane using search-guided particle filtering

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe a tracker that handles occlusion by clustering foreground pixels based on their disparity values. Stereo-matched foreground pixels, mapped from multiple views to a reference view, allow the tracker to recover occluded foreground regions in the reference view. The stereo algorithm utilizes a common plan view into which foreground regions from multiple views are projected and intersected to construct polygons that contain the ground plane locations of objects, followed by constraining the epipolar search to only those pixels with ground plane locations lying within these polygons. Consequently, a stereo-matched foreground pixel is easily mapped between views by first mapping its ground plane location using pre-computed homography, followed by intersecting the vertical axis passing through the mapped location with the epipolar line. Finally, tracking in a reference view allows a particle filter to be "seamlessly" integrated, so that uncertainties can be effectively dealt with. Experimental results illustrate the effectiveness of our algorithm.