Dynamic Shape and Appearance Modeling via Moving and Deforming Layers

Authors:
Jeremy D. Jackson;Anthony J. Yezzi;Stefano Soatto
Affiliations:
School of Electrical Engineering, Georgia Institute of Technology, Atlanta, USA 30332-0250;School of Electrical Engineering, Georgia Institute of Technology, Atlanta, USA 30332-0250;Department of Computer Science, University of California at Los Angeles, Los Angeles, USA 90095-1596
Venue:
International Journal of Computer Vision
Year:
2008

Citing 13
Cited 4

Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations

Journal of Computational Physics
Computation of discontinuous optical flow by domain decomposition and shape optimization

International Journal of Computer Vision
Geodesic Active Contours

International Journal of Computer Vision
Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects

IEEE Transactions on Pattern Analysis and Machine Intelligence
Image inpainting

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Computing Optical Flow with Physical Models of Brightness Variation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
DEFORMOTION: Deforming Motion, Shape Average and the Joint Registration and Segmentation of Images

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Optical-Flow Estimation while Preserving Its Discontinuities: A Variational Approach

ACCV '95 Invited Session Papers from the Second Asian Conference on Computer Vision: Recent Developments in Computer Vision
Gradient flows and geometric active contour models

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Non-rigid registration using distance functions

Computer Vision and Image Understanding - Special issue on nonrigid image registration
Highly Accurate Optic Flow Computation with Theoretically Justified Warping

International Journal of Computer Vision
A multiphase level set framework for motion segmentation

Scale Space'03 Proceedings of the 4th international conference on Scale space methods in computer vision

Dense and Deformable Motion Segmentation for Wide Baseline Images

SCIA '09 Proceedings of the 16th Scandinavian Conference on Image Analysis
Detachable object detection with efficient model selection

EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
Video-based descriptors for object recognition

Image and Vision Computing
Sparse Occlusion Detection with Optical Flow

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a model of the shape, motion and appearance of a scene, seen through a sequence of images, that captures occlusions, scene deformations, unconstrained viewpoint variations and changes in its radiance. This model is based on a collection of overlapping layers that can move and deform, each supporting an intensity function that can change over time. We discuss the generality and limitations of this model in relation to existing ones such as traditional optical flow or motion segmentation, layers, deformable templates and deformotion. We then illustrate how this model can be used for inference of shape, motion, deformation and appearance of the scene from a collection of images. The layering structure allows for automatic inpainting of partially occluded regions. We illustrate the model on synthetic and real sequences where existing schemes fail, and show how suitable choices of constants in the model yield existing schemes, from optical flow to motion segmentation and inpainting.