Symmetrical Dense Optical Flow Estimation with Occlusions Detection

Authors:
Luis Alvarez;Rachid Deriche;Théo Papadopoulo;Javier Sánchez
Affiliations:
Universidad de Las Palmas de Gran Canaria, Las Palmas, Spain;INRIA Sophia-Antipolis, Sophia-Antipolis, Cedex, France 06902;INRIA Sophia-Antipolis, Sophia-Antipolis, Cedex, France 06902;Universidad de Las Palmas de Gran Canaria, Las Palmas, Spain
Venue:
International Journal of Computer Vision
Year:
2007

Citing 28
Cited 15

An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence
On the estimation of dense displacement vector fields from image sequences

Proc. of the ACM SIGGRAPH/SIGART interdisciplinary workshop on Motion: representation and perception
On the estimation of optical flow: relations between different approaches and some new results

Artificial Intelligence
Investigations of multigrid algorithms for the estimation of optical flow fieldsin image sequences

Computer Vision, Graphics, and Image Processing
Determining optical flow for irregular domains by minimizing quadratic functionals of a certain class

International Journal of Computer Vision
Robust regression methods for computer vision: a review

International Journal of Computer Vision
On the Mathematical Foundations of Smoothness Constraints for the Determination of Optical Flow and for Surface Reconstruction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Image selective smoothing and edge detection by nonlinear diffusion. II

SIAM Journal on Numerical Analysis
Performance of optical flow techniques

International Journal of Computer Vision
Optical flow estimation: advances and comparisons

ECCV '94 Proceedings of the third European conference on Computer vision (vol. 1)
Determination of optical flow and its discontinuities using non-linear diffusion

ECCV '94 Proceedings of the third European conference on Computer Vision (Vol. II)
A Fast Scalable Algorithm for Discontinuous Optical Flow Estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence
On the unification of line processes, outlier rejection, and robust statistics with applications in early vision

International Journal of Computer Vision
Computing optical flow via variational techniques

SIAM Journal on Applied Mathematics
Reliable Estimation of Dense Optical Flow Fields with Large Displacements

International Journal of Computer Vision
On benchmarking optical flow

Computer Vision and Image Understanding - Special issue on empirical evaluation of computer vision algorithms
A Theoretical Framework for Convex Regularizers in PDE-Based Computation of Image Motion

International Journal of Computer Vision
Multimodal Estimation of Discontinuous Optical Flow using Markov Random Fields

IEEE Transactions on Pattern Analysis and Machine Intelligence
Symmetrical Dense Optical Flow Estimation with Occlusions Detection

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Symmetric Sub-Pixel Stereo Matching

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Brownian Warps: A Least Committed Prior for Non-rigid Registration

MICCAI '02 Proceedings of the 5th International Conference on Medical Image Computing and Computer-Assisted Intervention-Part II
Symmetrization of the Non-rigid Registration Problem Using Inversion-Invariant Energies: Application to Multiple Sclerosis

MICCAI '00 Proceedings of the Third International Conference on Medical Image Computing and Computer-Assisted Intervention
Optical-Flow Estimation while Preserving Its Discontinuities: A Variational Approach

ACCV '95 Invited Session Papers from the Second Asian Conference on Computer Vision: Recent Developments in Computer Vision
Nonlinear Matrix Diffusion for Optic Flow Estimation

Proceedings of the 24th DAGM Symposium on Pattern Recognition
Dense Matching of Multiple Wide-baseline Views

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms

International Journal of Computer Vision
Geometric Partial Differential Equations and Image Analysis

Geometric Partial Differential Equations and Image Analysis
Introduction To The Special Issue On Partial Differential Equations And Geometry-driven Diffusion In Image Processing And Analysis

IEEE Transactions on Image Processing

Moving gradients: a path-based method for plausible image interpolation

ACM SIGGRAPH 2009 papers
A new energy-based method for 3D motion estimation of incompressible PIV flows

Computer Vision and Image Understanding
Hyperbolic Numerics for Variational Approaches to Correspondence Problems

SSVM '09 Proceedings of the Second International Conference on Scale Space and Variational Methods in Computer Vision
A Non-rigid Registration Framework That Accommodates Resection and Retraction

IPMI '09 Proceedings of the 21st International Conference on Information Processing in Medical Imaging
Motion vision based structure estimation in forest environment

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Temporal constraints in large optical flow estimation

EUROCAST'07 Proceedings of the 11th international conference on Computer aided systems theory
The impact of nonlinear filtering and confidence information on optical flow estimation in a Lucas & Kanade framework

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Multi-layer stereo video matting: video matting

Proceedings of the international conference on Multimedia
Large displacement optical flow for volumetric image sequences

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Two algorithms for motion estimation from alternate exposure images

Proceedings of the 2010 international conference on Video Processing and Computational Video
Sparse Occlusion Detection with Optical Flow

International Journal of Computer Vision
A loop-consistency measure for dense correspondences in multi-view video

Image and Vision Computing
2.1 depth estimation of frames in image sequences using motion occlusions

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Consistent Binocular Depth and Scene Flow with Chained Temporal Profiles

International Journal of Computer Vision
3D Scene Reconstruction from Multiple Spherical Stereo Pairs

International Journal of Computer Vision

Quantified Score

Hi-index	0.01

Visualization

Abstract

Traditional techniques of dense optical flow estimation do not generally yield symmetrical solutions: the results will differ if they are applied between images I 1 and I 2 or between images I 2 and I 1. In this work, we present a method to recover a dense optical flow field map from two images, while explicitely taking into account the symmetry across the images as well as possible occlusions in the flow field. The idea is to consider both displacements vectors from I 1 to I 2 and I 2 to I 1 and to minimise an energy functional that explicitely encodes all those properties. This variational problem is then solved using the gradient flow defined by the Euler---Lagrange equations associated to the energy. To prove the importance of the concepts of symmetry and occlusions for optical flow computation, we have extended a classical approach to handle those. Experiments clearly show the added value of these properties to improve the accuracy of the computed flows.Figures appear in color in the online version of this paper.