A conversational model of multimodal interaction in information systems

  • Authors:
  • Adelheit Stein;Ulrich Thiel

  • Affiliations:
  • German National Research Center for Computer Science, Integrated Publication and Information Systems Institute, Darmstadt, Germany;German National Research Center for Computer Science, Integrated Publication and Information Systems Institute, Darmstadt, Germany

  • Venue:
  • AAAI'93 Proceedings of the eleventh national conference on Artificial intelligence
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a comprehensive framework for modeling and specifying multimodal interactions. To this end, we employ an extended notion of 'dialogue acts' which can be realized by linguistic and non-linguistic means. First, a set of constraints is presented that describes the temporal structure and all patterns of exchange during a cooperative informationseeking dialogue. Second, we introduce a strategic level of description which allows the specification of the topical structure according to an information-seeking strategy. The model was used to design and implement the MERIT system, and led to a reduction in the complexity of the user interface while preserving most of the useful, but sometimes confusing, dialogue options of advanced direct manipulation interfaces