A variational framework for the simultaneous segmentation and object behavior classification of image sequences

Authors:
Laura Gui;Jean-Philippe Thiran;Nikos Paragios
Affiliations:
Signal Processing Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland;Signal Processing Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland;Laboratoire MAS, Ecole Centrale de Paris, Chatenay-Malabry, France
Venue:
SSVM'07 Proceedings of the 1st international conference on Scale space and variational methods in computer vision
Year:
2007

Citing 17
Cited 1

Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations

Journal of Computational Physics
Tracking with Kalman snakes

Active vision
Shape Modeling with Front Propagation: A Level Set Approach

IEEE Transactions on Pattern Analysis and Machine Intelligence
Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation

International Journal of Computer Vision
A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model

International Journal of Computer Vision
Using Prior Shapes in Geometric Active Contours in a Variational Framework

International Journal of Computer Vision
Shape Priors for Level Set Representations

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Gradient flows and geometric active contour models

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Geodesic active contours

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Image Parsing: Unifying Segmentation, Detection, and Recognition

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Particle Filtering for Geometric Active Contours with Application to Tracking Moving and Deforming Objects

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
An Expectation Maximization Approach to the Synergy between Image Segmentation and Object Categorization

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
A Variational Model for Object Segmentation Using Boundary Information and Shape Prior Driven by the Mumford-Shah Functional

International Journal of Computer Vision
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Geodesic active regions and level set methods for motion estimation and tracking

Computer Vision and Image Understanding
Dynamical statistical shape priors for level set based sequence segmentation

VLSM'05 Proceedings of the Third international conference on Variational, Geometric, and Level Set Methods in Computer Vision
Active contours without edges

IEEE Transactions on Image Processing

Cooperative Object Segmentation and Behavior Inference in Image Sequences

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we advance the state of the art in variational image segmentation through the fusion of bottom-up segmentation and top-down classification of object behavior over an image sequence. Such an approach is beneficial for both tasks and is carried out through a joint optimization, which enables the two tasks to cooperate, such that knowledge relevant to each can aid in the resolution of the other, thereby enhancing the final result. In particular, classification offers dynamic probabilistic priors to guide segmentation, while segmentation supplies its results to classification, ensuring that they are consistent with prior knowledge. The prior models are learned from training data and updated dynamically, based on segmentations of earlier images in the sequence. We demonstrate the potential of our approach in a hand gesture recognition application, where the combined use of segmentation and classification improves robustness in the presence of occlusion and background complexity.