Using context and sensory data to learn first and second person pronouns

  • Authors:
  • Kevin Gold;Brian Scassellati

  • Affiliations:
  • Yale University, New Haven, CT;Yale University, New Haven, CT

  • Venue:
  • Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a method of grounded word learning that can learn the meanings of first and second person pronouns. The model selectively associates new words with agents in the environment by using already understood words to establish context. The method uses chi-square tests to find significant associations between the new words and attributes of the relevant agents. We show that this model can learn from a transcript of a parent-child interaction that "I" refers to the person who is speaking. With the additional information that questions about wants refer to the person being asked about them, the system learns that "you" refers to the person being addressed. We show that an incorrect assumption about the subject of "want" questions can lead to pronoun reversal, a linguistic error most commonly found in autistic and congenitally blind children. Finally, we present results from a physical implementation on a robot that runs in real time.