2009 Special Issue: Neural associative memories for the integration of language, vision and action in an autonomous agent

  • Authors:
  • H. Markert;U. Kaufmann;Z. Kara Kayikci;G. Palm

  • Affiliations:
  • Institute of Neural Information Processing, University of Ulm, 89069 Ulm, Germany;Institute of Neural Information Processing, University of Ulm, 89069 Ulm, Germany;Institute of Neural Information Processing, University of Ulm, 89069 Ulm, Germany;Institute of Neural Information Processing, University of Ulm, 89069 Ulm, Germany

  • Venue:
  • Neural Networks
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Language understanding is a long-standing problem in computer science. However, the human brain is capable of processing complex languages with seemingly no difficulties. This paper shows a model for language understanding using biologically plausible neural networks composed of associative memories. The model is able to deal with ambiguities on the single word and grammatical level. The language system is embedded into a robot in order to demonstrate the correct semantical understanding of the input sentences by letting the robot perform corresponding actions. For that purpose, a simple neural action planning system has been combined with neural networks for visual object recognition and visual attention control mechanisms.