Visual motion pattern extraction and fusion for collision detection in complex dynamic scenes

Authors:
Shigang Yue;F. Claire Rind
Affiliations:
Brain Mapping Unit, C/O Experimental Psychology, University of Cambridge, Downiing Site and School of Biology and Psychology, Faculty of Science, Agriculture and Engineering, University of Newcast ...;School of Biology and Psychology, Faculty of Science, Agriculture and Engineering, University of Newcastle upon Tyne, Newcastle upon Tyne, UK
Venue:
Computer Vision and Image Understanding
Year:
2006

Citing 4
Cited 7

Self-organizing neural networks for perception of visual motion

Neural Networks
Vision for Mobile Robot Navigation: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Silicon Implementation of the Fly's Optomotor Control System

Neural Computation
A bio-inspired visual collision detection mechanism for cars: Optimisation of a model of a locust neuron to a novel environment

Neurocomputing

A Synthetic Vision System Using Directionally Selective Motion Detectors to Recognize Collision

Artificial Life
Expansion segmentation for visual collision detection and estimation

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
A modified neural network model for Lobula Giant movement detector with additional depth movement feature

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Reactive direction control for a mobile robot: a locust-like control of escape direction emerges when a bilateral pair of model locust visual neurons are integrated

Autonomous Robots
Constraints of biological neural networks and their consideration in AI applications

Advances in Artificial Intelligence - Special issue on artificial intelligence in neuroscience and systems biology: lessons learnt, open problems, and the road ahead
A modified model for the Lobula Giant Movement Detector and its FPGA implementation

Computer Vision and Image Understanding
Postsynaptic organisations of directional selective visual neural networks for collision detection

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Detecting colliding objects in complex dynamic scenes is a difficult task for conventional computer vision techniques. However, visual processing mechanisms in animals such as insects may provide very simple and effective solutions for detecting colliding objects in complex dynamic scenes. In this paper, we propose a robust collision detecting system, which consists of a lobula giant movement detector (LGMD) based neural network and a translating sensitive neural network (TSNN), to recognise objects on a direct collision course in complex dynamic scenes. The LGMD based neural network is specialized for recognizing looming objects that are on a direct collision course. The TSNN, which fuses the extracted visual motion cues from several whole field direction selective neural networks, is only sensitive to translating movements in the dynamic scenes. The looming cue and translating cue revealed by the two specialized visual motion detectors are fused in the present system via a decision making mechanism. In the system, the LGMD plays a key role in detecting imminent collision; the decision from TSNN becomes useful only when a collision alarm has been issued by the LGMD network. Using driving scenarios as an example, we showed that the bio-inspired system can reliably detect imminent colliding objects in complex driving scenes.