Affective state recognition in married couples' interactions using PCA-based vocal entrainment measures with multiple instance learning

Authors:
Chi-Chun Lee;Athanasios Katsamanis;Matthew P. Black;Brian R. Baucom;Panayiotis G. Georgiou;Shrikanth S. Narayanan
Affiliations:
Signal Analysis and Interpretation Laboratory, Los Angeles, CA;Signal Analysis and Interpretation Laboratory, Los Angeles, CA;Signal Analysis and Interpretation Laboratory, Los Angeles, CA;Department of Psychology, University of Southern California, Los Angeles, CA;Signal Analysis and Interpretation Laboratory, Los Angeles, CA;Signal Analysis and Interpretation Laboratory, Los Angeles, CA and Department of Psychology, University of Southern California, Los Angeles, CA
Venue:
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Year:
2011

Citing 2
Cited 2

A framework for multiple-instance learning

NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Primitives-based evaluation and estimation of emotions in speech

Speech Communication

Behavioral signal processing for understanding (distressed) dyadic interactions: some recent developments

J-HGBU '11 Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding
Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions

Computer Speech and Language

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recently there has been an increase in efforts in Behavioral Signal Processing (BSP), that aims to bring quantitative analysis using signal processing techniques in the domain of observational coding. Currently observational coding in fields such as psychology is based on subjective expert coding of abstract human interaction dynamics. In this work, we use a Multiple Instance Learning (MIL) framework, a saliencybased prediction model, with a signal-driven vocal entrainment measure as the feature to predict the affective state of a spouse in problem solving interactions. We generate 18 MIL classifiers to capture the variablelength saliency of vocal entrainment, and a cross-validation scheme with maximum accuracy and mutual information as the metric to select the best performing classifier for each testing couple. This method obtains a recognition accuracy of 53.93%, a 2.14% (4.13% relative) improvement over baseline model using Support Vector Machine. Furthermore, this MIL-based framework has potential for identifying meaningful regions of interest for further detailed analysis of married couples interactions.