Incorporating non-motion cues into 3d motion segmentation

Authors:
Amit Gruber;Yair Weiss
Affiliations:
School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel;School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel
Venue:
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
Year:
2006

Citing 13
Cited 5

Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
Multibody Grouping from Motion Images

International Journal of Computer Vision
Normalized Cuts and Image Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Evaluation and Selection of Models for Motion Segmentation

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Factorization with Uncertainty

ECCV '00 Proceedings of the 6th European Conference on Computer Vision-Part I
A Unified Mixture Framework for Motion Segmentation: Incorporating Spatial Coherence and Estimating the Number of Models

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Scene Segmentation from 3D Motion

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
A multi-body factorization method for motion analysis

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Motion Segmentation and Tracking Using Normalized Cuts

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
What Energy Functions Can Be Minimizedvia Graph Cuts?

IEEE Transactions on Pattern Analysis and Machine Intelligence
Motion segmentation with missing data using power factorization and GPCA

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Spatially coherent clustering using graph cuts

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs

IEEE Transactions on Information Theory

Motion Segmentation: a Review

Proceedings of the 2008 conference on Artificial Intelligence Research and Development: Proceedings of the 11th International Conference of the Catalan Association for Artificial Intelligence
Two-View Motion Segmentation with Model Selection and Outlier Removal by RANSAC-Enhanced Dirichlet Process Mixture Models

International Journal of Computer Vision
Multibody structure-and-motion segmentation by branch-and-bound model selection

IEEE Transactions on Image Processing
Enhanced Local Subspace Affinity for feature-based motion segmentation

Pattern Recognition
Energy-Based Geometric Multi-model Fitting

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

We address the problem of segmenting an image sequence into rigidly moving 3D objects. An elegant solution to this problem is the multibody factorization approach in which the measurement matrix is factored into lower rank matrices. Despite progress in factorization algorithms, the performance is still far from satisfactory and in scenes with missing data and noise, most existing algorithms fail. In this paper we propose a method for incorporating 2D non-motion cues (such as spatial coherence) into multibody factorization. We formulate the problem in terms of constrained factor analysis and use the EM algorithm to find the segmentation. We show that adding these cues improves performance in real and synthetic sequences.