Mutually Coordinated Anticipatory Multimodal Interaction

Authors:
Anton Nijholt;Dennis Reidsma;Herwin Welbergen;Rieks Akker;Zsofia Ruttkay
Affiliations:
Human Media Interaction Group (HMI) Department of Computer Science, University of Twente, The Netherlands;Human Media Interaction Group (HMI) Department of Computer Science, University of Twente, The Netherlands;Human Media Interaction Group (HMI) Department of Computer Science, University of Twente, The Netherlands;Human Media Interaction Group (HMI) Department of Computer Science, University of Twente, The Netherlands;Human Media Interaction Group (HMI) Department of Computer Science, University of Twente, The Netherlands
Venue:
Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction
Year:
2008

Citing 20
Cited 3

Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Information superhighways: multimedia users and futures

Information superhighways: multimedia users and futures
The media equation: how people treat computers, television, and new media like real people and places

The media equation: how people treat computers, television, and new media like real people and places
The automated design of believable dialogues for animated presentation teams

Embodied conversational agents
BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Model-based Animation of Coverbal Gesture

CA '02 Proceedings of the Computer Animation
Effects of echoic mimicry using hummed sounds on human-computer interaction

Speech Communication
Communicative humanoids: a computational model of psychosocial dialogue skills

Communicative humanoids: a computational model of psychosocial dialogue skills
Natural behavior of a listening agent

Lecture Notes in Computer Science
Presenting in Virtual Worlds: An Architecture for a 3D Anthropomorphic Presenter

IEEE Intelligent Systems
Proceedings of the 7th international conference on Intelligent Virtual Agents

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
The Behavior Markup Language: Recent Developments and Challenges

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Fluid Semantic Back-Channel Feedback in Dialogue: Challenges and Progress

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Generating nonverbal signals for a sensitive artificial listener

COST 2102'07 Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behaviours
Towards a common framework for multimodal generation: the behavior markup language

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Towards a reactive virtual trainer

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Proceedings of the 5th international conference on Entertainment Computing

ICEC'06 Proceedings of the 5th international conference on Entertainment Computing
Towards bi-directional dancing interaction

ICEC'06 Proceedings of the 5th international conference on Entertainment Computing
Interacting with a virtual conductor

ICEC'06 Proceedings of the 5th international conference on Entertainment Computing
The AMI meeting corpus: a pre-announcement

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction

Temporal interaction between an artificial orchestra conductor and human musicians

Computers in Entertainment (CIE) - SPECIAL ISSUE: Media Arts (Part II)
Multimodal plan representation for adaptable BML scheduling

IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
An incremental multimodal realizer for behavior co-articulation and coordination

IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce our research on anticipatory and coordinated interaction between a virtual human and a human partner. Rather than adhering to the turn taking paradigm, we choose to investigate interaction where there is simultaneous expressive behavior by the human interlocutor and a humanoid. Various applications in which we can study and specify such behavior, in particular behavior that requires synchronization based on predictions from performance and perception, are presented. Some observations concerning the role of predictions in conversations are presented and architectural consequences for the design of virtual humans are drawn.