Learning word meaning and grammatical constructions from narrated video events

  • Authors:
  • Peter Ford Dominey;Thomas Voegtlin

  • Affiliations:
  • Institut des Sciences Cognitives, CNRS, Bron Cedex, France;Humboldt-Universität, Berlin, Germany

  • Venue:
  • HLT-NAACL-LWM '04 Proceedings of the HLT-NAACL 2003 workshop on Learning word meaning from non-linguistic data - Volume 6
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The objective of this research is to develop a system for miniature language learning based on a minimum of prewired language-specific functionality, that is compatible with observations of perceptual and language capabilities in human development. In the proposed system, meaning is extracted from video images based on detection of physical contact and its parameters. Mapping of sentence form to meaning is performed by learning grammatical constructions that are retrieved from a construction inventory based on the constellation of closed class items uniquely identifying the target sentence structure. The resulting system displays robust acquisition behavior that reproduces certain observations from developmental studies, with very modest "innate" language specificity.