Attention modulation using short- and long-term knowledge

  • Authors:
  • Sven Rebhan;Florian Röhrbein;Julian Eggert;Edgar Körner

  • Affiliations:
  • Honda Research Institute Europe GmbH, Offenbach am Main, Germany;Honda Research Institute Europe GmbH, Offenbach am Main, Germany;Honda Research Institute Europe GmbH, Offenbach am Main, Germany;Honda Research Institute Europe GmbH, Offenbach am Main, Germany

  • Venue:
  • ICVS'08 Proceedings of the 6th international conference on Computer vision systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

A fast and reliable visual search is crucial for representing visual scenes. The modulation of bottom-up attention plays an important role here. The knowledge about target features is often used to bias the bottom-up pathway. In this paper we propose a system which does not only make use of knowledge about the target features, but also uses already acquired knowledge about objects in the current scene to speed up the visual search. Main ingredients are a relational short term memory in combination with a semantic relational long term memory and an adjustable bottom-up saliency. The focus of this work is to investigate mechanisms to use the memory of the system efficiently. We show a proof-of-concept implementation working in a real-world environment and performing visual search tasks. It becomes clear that using the relational semantic memory in combination with spatial and feature modulation of the bottom-up path is beneficial for speeding up such search tasks.