Non-verbal cues for discourse structure

Authors:
Justine Cassell;Yukiko I. Nakano;Timothy W. Bickmore;Candace L. Sidner;Charles Rich
Affiliations:
MIT Media Laboratory, Cambridge, MA;MIT Media Laboratory, Cambridge, MA;MIT Media Laboratory, Cambridge, MA;Mitsubishi Electric Research Laboratories, Cambridge, MA;Mitsubishi Electric Research Laboratories, Cambridge, MA
Venue:
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Year:
2001

Citing 11
Cited 31

Attention, intentions, and the structure of discourse

Computational Linguistics
Communicative facial displays as a new conversational modality

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
An artificial discourse language for collaborative negotiation

AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Embodiment in conversational interfaces: Rea

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Using plan recognition in human-computer collaboration

UM '99 Proceedings of the seventh international conference on User modeling
Task-oriented collaboration with embodied agents in virtual worlds

Embodied conversational agents
Deictic and emotive communication in animated pedagogical agents

Embodied conversational agents
BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
COLLAGEN: A Collaboration Manager for Software Interface Agents

User Modeling and User-Adapted Interaction
A collaborative planning model of intentional structure

Computational Linguistics
Coordination and context-dependence in the generation of embodied conversation

INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14

Hosting activities: experience with and future directions for a robot agent host

Proceedings of the 7th international conference on Intelligent user interfaces
Human - Robot Interaction: Engagement between Humans and Robots for Hosting Activities

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Customisation and Context for Expressive Behaviour in the Broadband World

BT Technology Journal
Integrating Autonomous Behavior and User Control for Believable Agents

AAMAS '04 Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 1
Establishing and maintaining long-term human-computer relationships

ACM Transactions on Computer-Human Interaction (TOCHI)
Natural behavior of a listening agent

Lecture Notes in Computer Science
Direct manipulation like tools for designing intelligent virtual agents

Lecture Notes in Computer Science
'User as assessor' approach to embodied conversational agents

From brows to trust
Semantic back-pointers from gesture

NAACL-DocConsortium '06 Proceedings of the 2006 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume: doctoral consortium
Gesture modeling and animation based on a probabilistic re-creation of speaker style

ACM Transactions on Graphics (TOG)
Embodied conversational agents for voice-biometric interfaces

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Representing Communicative Function and Behavior in Multimodal Communication

Multimodal Signals: Cognitive and Algorithmic Issues
Culture-specific communication management for virtual agents

Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
From the programmer's apprentice to human-robot interaction: thirty years of research on human-computer collaboration

AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Some Pitfalls for Developing Enculturated Conversational Agents

Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
Comparing rule-based and data-driven selection of facial displays

EmbodiedNLP '07 Proceedings of the Workshop on Embodied Language Processing
Design and validation of ECA gestures to improve dialogue system robustness

EmbodiedNLP '07 Proceedings of the Workshop on Embodied Language Processing
Exploiting discourse structure for spoken dialogue performance analysis

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Multimodal floor control shift detection

Proceedings of the 2009 international conference on Multimodal interfaces
Multimodal end-of-turn prediction in multi-party meetings

Proceedings of the 2009 international conference on Multimodal interfaces
Motion modification method to control affective nuances for robots

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English

Speech Communication
Seeing is believing: body motion dominates in multisensory conversations

ACM SIGGRAPH 2010 papers
Modeling facial expression of uncertainty in conversational animation

ZiF'06 Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans
Culture-related differences in aspects of behavior for virtual characters across Germany and Japan

The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Posture, relationship, and discourse structure models of nonverbal behavior for long-term interaction

IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Conversational gaze mechanisms for humanlike robots

ACM Transactions on Interactive Intelligent Systems (TiiS)
Modeling gaze behavior for a 3d ECA in a dialogue situation

GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation
Towards influencing of the conversational agent mental state in the task of active listening

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
On speech and gestures synchrony

COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
Annotation of adversarial and collegial social actions in discourse

LAW VI '12 Proceedings of the Sixth Linguistic Annotation Workshop

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper addresses the issue of designing embodied conversational agents that exhibit appropriate posture shifts during dialogues with human users. Previous research has noted the importance of hand gestures, eye gaze and head nods in conversations between embodied agents and humans. We present an analysis of human monologues and dialogues that suggests that postural shifts can be predicted as a function of discourse state in monologues, and discourse and conversation state in dialogues. On the basis of these findings, we have implemented an embodied conversational agent that uses Collagen in such a way as to generate postural shifts.