A cross-situational algorithm for learning a lexicon using neural modeling fields

  • Authors:
  • José F. Fontanari;Vadim Tikhanoff;Angelo Cangelosi;Leonid I. Perlovsky

  • Affiliations:
  • Instituto de Fisica de São Carlos, Universidade de São Paulo, São Carlos, SP, Brazil;University of Plymouth, Plymouth, UK;University of Plymouth, Plymouth, UK;Harvard University, Cambridge and The Air Force Research Laboratory, SN, Hanscom Air Force Base, MA

  • Venue:
  • IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Cross-situational learning is based on the idea that a learner can determine the meaning of a word by finding something in common across all observed uses of that word. Although cross-situational learning is usually modeled through stochastic guessing games in which the input data vary erratically with time (or rounds of the game), here we investigate the possibility of applying the deterministic Neural Modeling Fields (NMF) categorization mechanism to infer the correct object-word mapping. Two different representations of the input data were considered. The first is termed object-word representation because it takes as inputs all possible object-word pairs and weighs them by their frequencies of occurrence in the stochastic guessing game. A re-interpretation of the problem within the perspective of learning with noise indicates that the cross-situational scenario produces a too low signal-to-noise ratio, explaining thus the failure of NMF to infer the correct object-word mapping. The second representation, termed context-word, takes as inputs all the objects that are in the pupil's visual field (context) when a word is uttered by the teacher. In this case we show that use of two levels of hierarchy of NMF allows the inference of the correct object-word mapping.