Visual Salience and Reference Resolution in Simulated 3-D Environments

  • Authors:
  • J. Kelleher;J. Van Genabith

  • Affiliations:
  • Media Lab Europe, Sugar House Lane, Bellevue, Dublin 8, Ireland/ E-mail: john.kelleher@medialabeurope.org;National Center for Language Technology, School of Computing, Dublin City University, Dublin, Ireland/ E-mail: Josef@computing.dcu.ie

  • Venue:
  • Artificial Intelligence Review
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present a novel false colouring-based visual saliency algorithm and illustrate how it is used in the situated language interpreter (SLI) system to ground a reference resolution framework for natural language interfaces to 3-D simulated environments. The visual saliency algorithm allows us to dynamically maintain a model of the evolving visual context. The visual saliency scores associated with the elements in the context model can be used to resolve underspecified references.