Discovering group nonverbal conversational patterns with topics

Authors:
Dinesh Babu Jayagopi;Daniel Gatica-Perez
Affiliations:
Idiap Research Institute, Martigny, Switzerland;Idiap Research Institute, Martigny, Switzerland
Venue:
Proceedings of the 2009 international conference on Multimodal interfaces
Year:
2009

Citing 8
Cited 1

Latent dirichlet allocation

The Journal of Machine Learning Research
Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances

Proceedings of the 9th international conference on Multimodal interfaces
Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
You are fired! Nonverbal role analysis in competitive meetings

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
Modeling dominance in group conversations using nonverbal activity cues

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on multimodal processing in speech-based interactions
The AMI meeting corpus: a pre-announcement

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
Modeling individual and group actions in meetings with layered HMMs

IEEE Transactions on Multimedia
Automatic Meeting Segmentation Using Dynamic Bayesian Networks

IEEE Transactions on Multimedia

Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper addresses the problem of discovering conversational group dynamics from nonverbal cues extracted from thin-slices of interaction. We first propose and analyze a novel thin-slice interaction descriptor - a bag of group nonverbal patterns - which robustly captures the turn-taking behavior of the members of a group while integrating its leader's position. We then rely on probabilistic topic modeling of the interaction descriptors which, in a fully unsupervised way, is able to discover group interaction patterns that resemble prototypical leadership styles proposed in social psychology. Our method, validated on the Augmented Multi-Party Interaction (AMI) meeting corpus, facilitates the retrieval of group conversational segments where semantically meaningful group behaviours emerge, without the need of any previous labeling.