Influencing gestural representation of eventualities: insights from ontology

  • Authors:
  • Magdalena Lis

  • Affiliations:
  • Centre for Language Technology, University of Copenhagen, Copenhagen, Denmark

  • Venue:
  • Proceedings of the 14th ACM international conference on Multimodal interaction
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the present paper we report results of a pilot study on the verbal and gestural representation of eventualities. We investigate the relationship between eventuality characteristics, as reflected in linguistic categorizations of verbs denoting the eventuality referred to, and physical form of co-speech gesture. Most importantly we look at whether referent's ontological type, information about which we derive from plWordNet 1.5, correlates to the viewpoint adopted in co-occuring gesture. Our results indicate a strong correlation between eventuality type and gestural viewpoint and are the first step towards a model of gestural behaviour planning driven by referents' types as reflected in speech and categorized in linguistic ontologies.