Why can't José read?: the problem of learning semantic associations in a robot environment

  • Authors:
  • Peter Carbonetto;Nando de Freitas

  • Affiliations:
  • University of British Columbia;University of British Columbia

  • Venue:
  • HLT-NAACL-LWM '04 Proceedings of the HLT-NAACL 2003 workshop on Learning word meaning from non-linguistic data - Volume 6
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We study the problem of learning to recognise objects in the context of autonomous agents. We cast object recognition as the process of attaching meaningful concepts to specific regions of an image. In other words, given a set of images and their captions, the goal is to segment the image, in either an intelligent or naive fashion, then to find the proper mapping between words and regions. In this paper, we demonstrate that a model that learns spatial relationships between individual words not only provides accurate annotations, but also allows one to perform recognition that respects the real-time constraints of an autonomous, mobile robot.