Understanding scene descriptions as event simulations

  • Authors:
  • David L. Waltz

  • Affiliations:
  • University of Illinois at Urbana-Champaign

  • Venue:
  • ACL '80 Proceedings of the 18th annual meeting on Association for Computational Linguistics
  • Year:
  • 1980

Quantified Score

Hi-index 0.00

Visualization

Abstract

The language of scene descriptions must allow a hearer to build structures of schemas similar (to some level of detail) to those the speaker has built via perceptual processes. The understanding process in general requires a hearer to create and run "event simulations" to check the consistency and plausibility of a "picture" constructed from a speaker's description. A speaker must also run similar event simulations on his own descriptions in order to be able to judge when the hearer has been given sufficient information to construct an appropriate "picture", and to be able to respond appropriately to the hearer's questions about or responses to the scene description.In this paper I explore some simple scene description examples in which a hearer must make judgements involving reasoning about scenes, space, common-sense physics, cause-effect relationships, etc. While I propose some mechanisms for dealing with such scene descriptions, my primary concern at this time is to flesh out our understanding of just what the mechanisms must accomplish: what information will be available to them and what information must be found or generated to account for the inferences we know are actually made.