Changes in verbal and nonverbal conversational behavior in long-term interaction

Authors:
Daniel Schulman;Timothy Bickmore
Affiliations:
Northeastern University, Boston, MA, USA;Northeastern University, Boston, MA, USA
Venue:
Proceedings of the 14th ACM international conference on Multimodal interaction
Year:
2012

Citing 8
Cited 1

BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Towards integrated microplanning of language and iconic gesture for multimodal output

Proceedings of the 6th international conference on Multimodal interfaces
Gesture modeling and animation based on a probabilistic re-creation of speaker style

ACM Transactions on Graphics (TOG)
Coordination in conversation and rapport

EmbodiedNLP '07 Proceedings of the Workshop on Embodied Language Processing
Modeling behavioral manifestations of coordination and rapport over multiple conversations: speaking rate as a relational indicator for a virtual agent

IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Posture, relationship, and discourse structure models of nonverbal behavior for long-term interaction

IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Virtual rapport

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Nonverbal behavior generator for embodied conversational agents

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents

Conversational gaze aversion for humanlike robots

Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an empirical investigation of conversational behavior in dyadic interaction spanning multiple conversations, in the context of a developing interpersonal relationship between a health counselor and her clients. Using a longitudinal video corpus of behavior change counseling conversations, we show systematic changes in verbal and nonverbal behavior during greetings (within the first minute of conversations). Both the number of prior conversations and self-reported assessments of the strength of the interpersonal relationship are predictive of changes in verbal and nonverbal behavior. We present a model and implementation of nonverbal behavior generation for conversational agents that incorporates these findings, and discuss how the results can be applied to multimodal recognition of conversational behavior over time.