On the relationship between image and motion segmentation

Authors:
Adrian Barbu;Song Chun Zhu
Affiliations:
UCLA, Computer Science Department, Los Angeles, CA;UCLA, Statistics Department, Los angeles, CA
Venue:
SCVMA'04 Proceedings of the First international conference on Spatial Coherence for Visual Motion Analysis
Year:
2004

Citing 6
Cited 0

Robot vision

Robot vision
Estimating Optical Flow in Segmented Images Using Variable-Order Parametric Models With Local Deformations

IEEE Transactions on Pattern Analysis and Machine Intelligence
Smoothness in Layers: Motion segmentation using nonparametric mixture estimation.

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Accurate Motion Flow Estimation with Discontinuities

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Graph Partition by Swendsen-Wang Cuts

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Variational Space-Time Motion Segmentation

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a generative model for image sequences, which can be applied to motion segmentation and tracking, and to image sequence compression. The model consists of regions of relatively constant color that have a motion model explaining their motion in time. At each frame, the model can allow accretion and deletion of pixels. We also present an algorithm for maximizing the posterior probability of the image sequence model, based on the recently introduced Swendsen-Wang Cuts algorithm. We show how one can use multiple cues and model switching in a reversible manner to make better bottom-up proposals. The algorithm works on the 3d spatiotemporal pixel volume to reassign entire trajectories of constant color in very few steps, while maintaining detailed balance.