A neural network for the processing of optic flow from ego-motion in man and higher mammals

Authors:
Markus Lappe;Josef P. Rauschecker
Affiliations:
Laboratory of Neurophysiology, NIMH, Poolesville, MD 20837, USA and Max Planck Institute for Biological Cybernetics, Tübingen, Germany;Laboratory of Neurophysiology, NIMH, Poolesville, MD 20837, USA and Max Planck Institute for Biological Cybernetics, Tübingen, Germany
Venue:
Neural Computation
Year:
1993

Citing 5
Cited 5

Computing optical flow in the primate visual system

Neural Computation
Visual perception of three-dimensional motion

Neural Computation
Visual navigation with a neural network

Neural Networks
Measurement of Visual Motion

Measurement of Visual Motion
Computation of Heading Direction from Optic Flow in Visual Cortex

Advances in Neural Information Processing Systems 5, [NIPS Conference]

Tracking through Optical Snow

BMCV '02 Proceedings of the Second International Workshop on Biologically Motivated Computer Vision
Functional consequences of an integration of motion and stereopsis in area mt of monkey extrastriate visual cortex

Neural Computation
Unmanned navigation of the 1/10 vehicle using U-SAT

NPC'07 Proceedings of the 2007 IFIP international conference on Network and parallel computing
A review and evaluation of methods estimating ego-motion

Computer Vision and Image Understanding
A bio-inspired, computational model suggests velocity gradients of optic flow locally encode ordinal depth at surface borders and globally they encode self-motion

Neural Computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Interest in the processing of optic flow has increased recently in both the neurophysiological and the psychophysical communities. We have designed a neural network model of the visual motion pathway in higher mammals that detects the direction of heading from optic flow. The model is a neural implementation of the subspace algorithm introduced by Heeger and Jepson (1990). We have tested the network in simulations that are closely related to psychophysical and neurophysiological experiments and show that our results are consistent with recent data from both fields. The network reproduces some key properties of human ego-motion perception. At the same time, it produces neurons that are selective for different components of ego-motion flow fields, such as expansions and rotations. These properties are reminiscent of a subclass of neurons in cortical area MSTd, the triple-component neurons. We propose that the output of such neurons could be used to generate a computational map of heading directions in or beyond MST.