Extraction of layers of similar motion through combinatorial techniques

Authors:
Romain Dupont;Nikos Paragios;Renaud Keriven;Phillipe Fuchs
Affiliations:
,Atlantis Research Group, CERTIS ENPC, Marne-La-Vallee, France;Atlantis Research Group, CERTIS ENPC, Marne-La-Vallee, France;Atlantis Research Group, CERTIS ENPC, Marne-La-Vallee, France;Centre de Robotique, CAOR ENSMP, Paris, France
Venue:
EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Year:
2005

Citing 13
Cited 1

The theory and practice of Bayesian image labeling

International Journal of Computer Vision
The robust estimation of multiple motions: parametric and piecewise-smooth flow fields

Computer Vision and Image Understanding
Estimating Optical Flow in Segmented Images Using Variable-Order Parametric Models With Local Deformations

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Unified Approach to Moving Object Detection in 2D and 3D Scenes

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast Approximate Energy Minimization via Graph Cuts

IEEE Transactions on Pattern Analysis and Machine Intelligence
Cooperative Robust Estimation Using Layers of Support

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hierarchical Model-Based Motion Estimation

ECCV '92 Proceedings of the Second European Conference on Computer Vision
Smoothness in Layers: Motion segmentation using nonparametric mixture estimation.

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Skin and Bones: Multi-layer, Locally Affine, Optical Flow and Regularization with Transparency

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Variational Space-Time Motion Segmentation

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Spatially coherent clustering using graph cuts

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Motion layer extraction in the presence of occlusion using graph cut

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition

Interactive video layer decomposition and matting

ACCV'10 Proceedings of the 2010 international conference on Computer vision - Volume part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a new technique to extract layers in a video sequence. To this end, we assume that the observed scene is composed of several transparent layers, that their motion in the 2D plane can be approximated with an affine model. The objective of our approach is the estimation of these motion models as well as the estimation of their support in the image domain. Our technique is based on an iterative process that integrates robust motion estimation, MRF-based formulation, combinatorial optimization and the use of visual as well as motion features to recover the parameters of the motion models as well as their support layers. Special handling of occlusions as well as adaptive techniques to detect new objects in the scene are also considered. Promising results demonstrate the potentials of our approach.