Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation

Authors:
Thomas Brox;Jitendra Malik
Affiliations:
University of California at Berkeley, Berkeley;University of California at Berkeley, Berkeley
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2011

Citing 0
Cited 31

Dense point trajectories by GPU-accelerated large displacement optical flow

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Object segmentation by long term analysis of point trajectories

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Dense multi-frame optic flow for non-rigid objects using subspace constraints

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Robust trajectory-space TV-L1 optical flow for non-rigid sequences

EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
Large displacement optical flow for volumetric image sequences

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Analysis of recent advances in optical flow estimation methods

EUROCAST'11 Proceedings of the 13th international conference on Computer Aided Systems Theory - Volume Part I
Robust patch-based hdr reconstruction of dynamic scenes

ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
A loop-consistency measure for dense correspondences in multi-view video

Image and Vision Computing
Exposure stacks of live scenes with hand-held cameras

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Scale invariant optical flow

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Two-granularity tracking: mediating trajectory and detection graphs for tracking under occlusions

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
To track or to detect? an ensemble framework for optimal selection

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
A naturalistic open source movie for optical flow evaluation

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Going with the flow: pedestrian efficiency in crowded scenes

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
SuperFloxels: a mid-level representation for video sequences

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
A landmark-based primal-dual approach for discontinuity preserving registration

MICCAI'12 Proceedings of the 4th international conference on Abdominal Imaging: computational and clinical applications
Application of heterogenous motion models towards structure recovery from motion

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Online learning for fast segmentation of moving objects

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Adaptive integration of feature matches into variational optical flow methods

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
An anchor patch based optimization framework for reducing optical flow drift in long image sequences

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Dense scene flow based on depth and multi-channel bilateral filter

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Detecting changes in images of street scenes

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part IV
Hierarchical scan-line dynamic programming for optical flow using semi-global matching

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
Background subtraction via coherent trajectory decomposition

Proceedings of the 21st ACM international conference on Multimedia
Patch-based high dynamic range video

ACM Transactions on Graphics (TOG)
Histogram-Based Optical Flow for Motion Estimation in Ultrasound Imaging

Journal of Mathematical Imaging and Vision
Editor's Choice Article: Motion-based segmentation of objects using overlapping temporal windows

Image and Vision Computing
Detecting bipedal motion from correlated probabilistic trajectories

Pattern Recognition Letters
A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them

International Journal of Computer Vision
Automatic objects segmentation with RGB-D cameras

Journal of Visual Communication and Image Representation
Spectral Log-Demons: Diffeomorphic Image Registration with Very Large Deformations

International Journal of Computer Vision

Quantified Score

Hi-index	0.14

Visualization

Abstract

Optical flow estimation is classically marked by the requirement of dense sampling in time. While coarse-to-fine warping schemes have somehow relaxed this constraint, there is an inherent dependency between the scale of structures and the velocity that can be estimated. This particularly renders the estimation of detailed human motion problematic, as small body parts can move very fast. In this paper, we present a way to approach this problem by integrating rich descriptors into the variational optical flow setting. This way we can estimate a dense optical flow field with almost the same high accuracy as known from variational optical flow, while reaching out to new domains of motion analysis where the requirement of dense sampling in time is no longer satisfied.