Interpreting pointing gestures and spoken requests: a probabilistic, salience-based approach

  • Authors:
  • Ingrid Zukerman;Gideon Kowadlo;Patrick Ye

  • Affiliations:
  • Monash University;Monash University;Monash University

  • Venue:
  • COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a probabilistic, salience-based approach to the interpretation of pointing gestures together with spoken utterances. Our mechanism models dependencies between spatial and temporal aspects of gestures and features of utterances. For our evaluation, we collected a corpus of requests which optionally included pointing. Our results show that pointing information improves interpretation accuracy.