Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information

Authors:
Angeliki Metallinou;Athanasios Katsamanis;Shrikanth Narayanan
Affiliations:
-;-;-
Venue:
Image and Vision Computing
Year:
2013

Citing 22
Cited 1

Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy

IEEE Transactions on Pattern Analysis and Machine Intelligence
2005 Special Issue: Framewise phoneme classification with bidirectional LSTM and other neural network architectures

Neural Networks - 2005 Special issue: IJCNN 2005
Long Short-Term Memory

Neural Computation
Bi-modal emotion recognition from expressive face and body gestures

Journal of Network and Computer Applications
Primitives-based evaluation and estimation of emotions in speech

Speech Communication
Statistical mapping between articulatory movements and acoustic spectrum using a Gaussian mixture model

Speech Communication
Recognizing Affective Dimensions from Body Posture

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Detecting Affect from Non-stylised Body Motions

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Recognising Human Emotions from Body Movement and Gesture Dynamics

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic temporal segment detection and affect recognition from face and body display

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Automatic analysis of affective postures and body motion to detect engagement with a game companion

Proceedings of the 6th international conference on Human-robot interaction
Toward a Minimal Representation of Affective Gestures

IEEE Transactions on Affective Computing
Multi-score learning for affect recognition: the case of body postures

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Naturalistic affective expression classification by a multi-stage approach based on hidden Markov models

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
A Multimodal Database for Affect Recognition and Implicit Tagging

IEEE Transactions on Affective Computing
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory

IEEE Transactions on Audio, Speech, and Language Processing
Affective video content representation and modeling

IEEE Transactions on Multimedia
A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media

IEEE Transactions on Multimedia
Automatic Recognition of Non-Acted Affective Postures

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A Globally-Variant Locally-Constant Model for Fusion of Labels from Multiple Diverse Experts without Using Reference Labels

IEEE Transactions on Pattern Analysis and Machine Intelligence

Editorial: Introduction To The Special Issue On Affect Analysis In Continuous Input

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We address the problem of tracking continuous levels of a participant's activation, valence and dominance during the course of affective dyadic interactions, where participants may be speaking, listening or doing neither. To this end, we extract detailed and intuitive descriptions of each participant's body movements, posture and behavior towards his interlocutor, and speech information. We apply a Gaussian Mixture Model-based approach which computes a mapping from a set of observed audio-visual cues to an underlying emotional state. We obtain promising results for tracking trends of participants' activation and dominance values, which outperform other regression-based approaches used in the literature. Additionally, we shed light into the way expressive body language is modulated by underlying emotional states in the context of dyadic interactions.