Neural-swarm visual saliency for path following

  • Authors:

  • Pedro Santana;Ricardo MendonçA;LuíS Correia;José Barata

  • Affiliations:

  • CTS-UNINOVA, New University of Lisbon, Portugal and Instituto Universitário de Lisboa (ISCTE-IUL), Portugal;CTS-UNINOVA, New University of Lisbon, Portugal;LabMAg, Computer Science Department, University of Lisbon, Portugal;CTS-UNINOVA, New University of Lisbon, Portugal

  • Venue:
  • Applied Soft Computing
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper extends an existing saliency-based model for path detection and tracking so that the appearance of the path being followed can be learned and used to bias the saliency computation process. The goal is to reduce ambiguities in the presence of strong distractors. In both original and extended path detectors, neural and swarm models are layered in order to attain a hybrid solution. With generalisation to other tasks in mind, these detectors are presented as instances of a generic neural-swarm layered architecture for visual saliency computation. The architecture considers a swarm-based substrate for the extraction of high-level perceptual representations, given the low-level perceptual representations extracted by a neural-based substrate. The goal of this division of labour is to ensure parallelism across the vision system while maintaining scalability and tractability. The proposed model is shown to exhibit, at 20Hz, a 98.67% success rate on a diverse data-set composed of 39 videos encompassing a total of 29,789 640x480 frames. An open source implementation of the model, fully encapsulated as a node of the Robotics Operating System (ROS), is available for download.