Representing Communicative Function and Behavior in Multimodal Communication

  • Authors:
  • Hannes Högni Vilhjálmsson

  • Affiliations:
  • Center for Analysis and Design of Intelligent Agents (CADIA) School of Computer Science, Reykjavík University, Reykjavík, Iceland 103

  • Venue:
  • Multimodal Signals: Cognitive and Algorithmic Issues
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization. I briefly outline the proposed SAIBA framework for multimodal generation of communicative behavior, which is an international research platform that fosters the exchange of components between different systems. The SAIBA framework currently contains a first draft of the lower level Behavior Markup Language (BML) and is starting work on the higher level Function Markup Language (FML). I also briefly explain the usefulness of this distinction by using examples of several implemented systems that each draws different strengths from it. These systems range from autonomous conversational agents to computer mediated communication.