Towards Programming Multimodal Dialogues

Authors:
N. L. Vergunst;B. R. Steunebrink;M. Dastani;F. P. M. Dignum;J.-J. Ch. Meyer
Affiliations:
-;-;-;-;-
Venue:
WI-IATW '07 Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops
Year:
2007

Citing 6
Cited 1

Ten myths of multimodal interaction

Communications of the ACM
Designing Sociable Robots

Designing Sociable Robots
Q: A Scenario Description Language for Interactive Agents

Computer
IOM/T: an interaction description language for multi-agent systems

Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Multi-Agent Programming: Languages, Tools and Applications

Multi-Agent Programming: Languages, Tools and Applications
Integration and synchronization of input modes during multimodal human-computer interaction

ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment

2APL: a practical agent programming language

Autonomous Agents and Multi-Agent Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper identifies several issues in multimodal dialogues between a companion robot and a human user. Specifically, these issues pertain to the synchronization of multimodal input and output, and the handling of expected and unexpected input, including input contradicting over different modalities. Furthermore, a novel way of visually representing multimodal dialogues is presented. Ultimately, this work represents some steps towards the development of a principled and generic method for programming multimodal dialogues.