Dynamic shape and appearance modeling via moving and deforming layers

Authors:
Jeremy D. Jackson;Anthony Yezzi;Stefano Soatto
Affiliations:
School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA;School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA;Computer Science Department, UCLA, Los Angeles, CA
Venue:
EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Year:
2005

Citing 12
Cited 3

Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations

Journal of Computational Physics
Computation of discontinuous optical flow by domain decomposition and shape optimization

International Journal of Computer Vision
Geodesic Active Contours

International Journal of Computer Vision
Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects

IEEE Transactions on Pattern Analysis and Machine Intelligence
Image inpainting

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Computing Optical Flow with Physical Models of Brightness Variation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
DEFORMOTION: Deforming Motion, Shape Average and the Joint Registration and Segmentation of Images

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
A Scale-Space Approach to Nonlocal Optical Flow Calculations

SCALE-SPACE '99 Proceedings of the Second International Conference on Scale-Space Theories in Computer Vision
Optical-Flow Estimation while Preserving Its Discontinuities: A Variational Approach

ACCV '95 Invited Session Papers from the Second Asian Conference on Computer Vision: Recent Developments in Computer Vision
Non-rigid registration using distance functions

Computer Vision and Image Understanding - Special issue on nonrigid image registration
A multiphase level set framework for motion segmentation

Scale Space'03 Proceedings of the 4th international conference on Scale space methods in computer vision

Dynamic Shape and Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Detachable object detection with efficient model selection

EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
Sparse Occlusion Detection with Optical Flow

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a model of the shape, motion and appearance of a sequence of images that captures occlusions, scene deformations, arbitrary viewpoint variations and changes in irradiance. This model is based on a collection of overlapping layers that can move and deform, each supporting an intensity function that can change over time. We discuss the generality and limitations of this model in relations to existing ones such as traditional optical flow or motion segmentation, layers, deformable templates and deformotion. We then illustrate how this model can be used for inference of shape, motion, deformation and appearance of the scene from a collection of images. The layering structure allows for automatic inpainting of partially occluded regions. We illustrate the model on synthetic and real sequences where existing schemes fail; we implement our gradient-based infinite-dimensional optimization using level set methods.