Motion segmentation using an occlusion detector

Authors:
Doron Feldman;Daphna Weinshall
Affiliations:
School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel;School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel
Venue:
WDV'05/WDV'06/ICCV'05/ECCV'06 Proceedings of the 2005/2006 international conference on Dynamical vision
Year:
2006

Citing 15
Cited 0

Scene Segmentation from Visual Motion Using Global Optimization

IEEE Transactions on Pattern Analysis and Machine Intelligence
Compact Representations of Videos Through Dominant and Multiple Motion Estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Edge Detection and Ridge Detection with Automatic Scale Selection

International Journal of Computer Vision
Probabilistic Detection and Tracking of Motion Boundaries

International Journal of Computer Vision - Special issue on Genomic Signal Processing
Smoothness in Layers: Motion segmentation using nonparametric mixture estimation.

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
A Unified Mixture Framework for Motion Segmentation: Incorporating Spatial Coherence and Estimating the Number of Models

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
MRF-based motion segmentation exploiting a 2D motion model robust estimation

ICIP '95 Proceedings of the 1995 International Conference on Image Processing (Vol. 3)-Volume 3 - Volume 3
Visual Integration and Detection of Discontinuities: The Key Role of Intensity Edges

Visual Integration and Detection of Discontinuities: The Key Role of Intensity Edges
Motion Segmentation and Tracking Using Normalized Cuts

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Space-time Interest Points

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Comparison of Graph Cuts with Belief Propagation for Stereo, using Identical MRF Parameters

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Velocity Adaptation of Space-Time Interest Points

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
A Voting-Based Computational Framework for Visual Motion Analysis and Interpretation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Motion Segmentation Using Occlusions

IEEE Transactions on Pattern Analysis and Machine Intelligence
An iterative image registration technique with an application to stereo vision

IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a novel method for the detection of motion boundaries in a video sequence based on differential properties of the spatio-temporal domain. Regarding the video sequence as a 3D spatio-temporal function, we consider the second moment matrix of its gradients (averaged over a local window), and show that the eigenvalues of this matrix can be used to detect occlusions and motion discontinuities. Since these cannot always be determined locally (due to false corners and the aperture problem), a scale-space approach is used for extracting the location of motion boundaries. A closed contour is then constructed from the most salient boundary fragments, to provide the final segmentation. The method is shown to give good results on pairs of real images taken in general motion. We use synthetic data to show its robustness to high levels of noise and illumination changes; we also include cases where no intensity edge exists at the location of the motion boundary, or when no parametric motion model can describe the data.