Towards a common framework for multimodal generation: the behavior markup language

  • Authors:

  • Stefan Kopp;Brigitte Krenn;Stacy Marsella;Andrew N. Marshall;Catherine Pelachaud;Hannes Pirker;Kristinn R. Thórisson;Hannes Vilhjálmsson

  • Affiliations:

  • Artificial .Intelligence Group, University of Bielefeld, Germany;Austrian Research Institute for AI (OFAI), Vienna, Austria;Information Sciences Institute, University of Southern California;Information Sciences Institute, University of Southern California;IUT de Montreuil, University de Paris 8, France;Austrian Research Institute for AI (OFAI), Vienna, Austria;CADIA, Dept. Of Computer Science, Reykjavik University, Iceland;Information Sciences Institute, University of Southern California

  • Venue:
  • IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes an international effort to unify a multimodal behavior generation framework for Embodied Conversational Agents (ECAs). We propose a three stage model we call SAIBA where the stages represent intent planning, behavior planning and behavior realization. A Function Markup Language (FML), describing intent without referring to physical behavior, mediates between the first two stages and a Behavior Markup Language (BML) describing desired physical realization, mediates between the last two stages. In this paper we will focus on BML. The hope is that this abstraction and modularization will help ECA researchers pool their resources to build more sophisticated virtual humans.