Robust recognition of emotion from speech

Authors:
Mohammed E. Hoque;Mohammed Yeasin;Max M. Louwerse
Affiliations:
Department of Electrical and Computer Engineering / Institute for Intelligent Systems;Department of Electrical and Computer Engineering / Institute for Intelligent Systems;Department of Psychology / Institute for Intelligent Systems, The University of Memphis, Memphis, TN
Venue:
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Year:
2006

Citing 8
Cited 3

Affective computing

Affective computing
Intelligent tutoring systems with conversational dialogue

AI Magazine
Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments

User Modeling and User-Adapted Interaction
Emotion Detection from Speech to Enrich Multimedia Content

PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
An Affective Model of Interplay between Emotions and Learning: Reengineering Educational Pedagogy-Building a Learning Companion

ICALT '01 Proceedings of the IEEE International Conference on Advanced Learning Technologies
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Prosody based audiovisual coanalysis for coverbal gesture recognition

IEEE Transactions on Multimedia

Automatic inference of complex affective states

Computer Speech and Language
Emotion recognition from speech: a review

International Journal of Speech Technology
Level of interest sensing in spoken dialog using decision-level fusion of acoustic and lexical evidence

Computer Speech and Language

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents robust recognition of a subset of emotions by animated agents from salient spoken words. To develop and evaluate the model for each emotion from the chosen subset, both the prosodic and acoustic features were used to extract the intonational patterns and correlates of emotion from speech samples. The computed features were projected using a combination of linear projection techniques for compact and clustered representation of features. The projected features were used to build models of emotions using a set of classifiers organized in hierarchical fashion. The performances of the models were obtained using number of classifiers from the WEKA machine learning toolbox. Empirical analysis indicated that the lexical information computed from both the prosodic and acoustic features at word level yielded robust classification of emotions.