A recurrent multimodal network for binding written words and sensory-based semantics into concepts

Authors:
Andrew P. Papliński;Lennart Gustafsson;William M. Mount
Affiliations:
Monash University, Australia;Luleå University of Technology, Sweden;Monash University, Australia
Venue:
ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part I
Year:
2011

Citing 5
Cited 2

Self-Organizing Maps

Self-Organizing Maps
Modeling the Bilingual Lexicon of an Individual Subject

WSOM '09 Proceedings of the 7th International Workshop on Advances in Self-Organizing Maps
An unsupervised learning method for representing simple sentences

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
A self-organized artificial neural network architecture for sensory integration with applications to letter-phoneme integration

Neural Computation
Feedback in multimodal self-organizing networks enhances perception of corrupted stimuli

AI'06 Proceedings of the 19th Australian joint conference on Artificial Intelligence: advances in Artificial Intelligence

Incremental self-organizing map (iSOM) in categorization of visual objects

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part II
The angular integral of the radon transform (aniRT) as a feature vector in categorization of visual objects

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a recurrent multimodal model of binding written words to mental objects and investigate the capability of the network in reading misspelt but categorically related words. Our model consists of three mutually interconnected association modules which store mental objects, represent their written names and bind these together to form mental concepts. A feedback gain controlling top-down influence is incorporated into the model architecture and it is shown that correct settings for this during map formation and simulated reading experiments is necessary for correct interpretation and semantic binding of the written words.