Detecting changing emotions in natural speech

Authors:
Wojtek Kowalczyk;C. Natalie van der Wal
Affiliations:
Department of Artificial Intelligence, VU University Amsterdam, Amsterdam, The Netherlands;Department of Artificial Intelligence, VU University Amsterdam, Amsterdam, The Netherlands
Venue:
IEA/AIE'12 Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence
Year:
2012

Citing 9
Cited 0

Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond

Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Random Forests

Machine Learning
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Automatic Recognition of Emotions from Speech: A Review of the Literature and Recommendations for Practical Realisation

Affect and Emotion in Human-Computer Interaction
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech

Affect and Emotion in Human-Computer Interaction
Towards affective sensing

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Whodunnit - Searching for the most important feature types signalling emotion-related user states in speech

Computer Speech and Language
Expression of affect in spontaneous speech: Acoustic correlates and automatic detection of irritation and resignation

Computer Speech and Language
An extraction of emotion in human speech using cluster analysis and a regression tree

ACS'10 Proceedings of the 10th WSEAS international conference on Applied computer science

Quantified Score

Hi-index	0.00

Visualization

Abstract

The goal of this research was to develop a system that will automatically measure changes in the emotional state of a speaker, by analyzing his/her voice. Natural (non-acted) human speech of 77 (Dutch) speakers was collected and manually splitted into speech units. Three recordings per speaker were collected, in which he/she was in a positive, neutral and negative state. For each recording, the speakers rated 16 emotional states on a 10-point Likert Scale. The Random Forest algorithm was applied to 207 speech features that were extracted from recordings to qualify (classification) and quantify (regression) the changes in speaker's emotional state. Results showed that predicting the direction of change of emotions and the change of intensity, measured by Mean Squared Error, can be done better than the baseline (the mean value of change). Moreover, it turned out that changes in negative emotions are more predictable than changes in positive emotions.