Investigating the prosody and voice quality of social signals in scenario meetings

Authors:
Marcela Charfuelan;Marc Schröder
Affiliations:
DFKI GmbH, Language Technology Lab, Saarbrücken, Germany;DFKI GmbH, Language Technology Lab, Saarbrücken, Germany
Venue:
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Year:
2011

Citing 5
Cited 1

The role of voice quality in communicating emotion, mood and attitude

Speech Communication - Special issue on speech and emotion
Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Agreement detection in multiparty conversation

Proceedings of the 2009 international conference on Multimodal interfaces
The AMI meeting corpus: a pre-announcement

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
Transforming Perceived Vocal Effort and Breathiness Using Adaptive Pre-Emphasis Linear Prediction

IEEE Transactions on Audio, Speech, and Language Processing

A bottom-up exploration of the dimensions of dialog state in spoken interaction

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this study we propose a methodology to investigate possible prosody and voice quality correlates of social signals, and test-run it on annotated naturalistic recordings of scenario meetings. The core method consists of computing a set of prosody and voice quality measures, followed by a Principal Components Analysis (PCA) and Support Vector Machine (SVM) classification to identify the core factors predicting the associated social signal or related annotation. We apply the methodology to controlled data and two types of annotations in the AMI meeting corpus that are relevant for social signalling: dialogue acts and speaker roles.