Temporal Symbolic Integration Applied to a Multimodal System Using Gestures and Speech

  • Authors:
  • Timo Sowa;Martin Fröhlich;Marc Erich Latoschik

  • Affiliations:
  • -;-;-

  • Venue:
  • GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a technical approach for temporal symbol integration aimed to be generally applicable in unimodal and multimodal user interfaces. It draws its strength from symbolic data representation and an underlying rule-based system, and is embedded in a multiagent system. The core method for temporal integration is motivated by findings from cognitive science research. We discuss its application for a gesture recognition task and speech-gesture integration in a Virtual Construction scenario. Finally an outlook of an empirical evaluation is given.