Audio-Based Emotion Recognition in Judicial Domain: A Multilayer Support Vector Machines Approach

Authors:
E. Fersini;E. Messina;G. Arosio;F. Archetti
Affiliations:
DISCo, Università degli Studi di Milano-Bicocca, Milano, Italy 20126;DISCo, Università degli Studi di Milano-Bicocca, Milano, Italy 20126;DISCo, Università degli Studi di Milano-Bicocca, Milano, Italy 20126;DISCo, Università degli Studi di Milano-Bicocca, Milano, Italy 20126 and Consorzio Milano Ricerche, Milano, Italy 20129
Venue:
MLDM '09 Proceedings of the 6th International Conference on Machine Learning and Data Mining in Pattern Recognition
Year:
2009

Citing 3
Cited 4

How to find trouble in communication

Speech Communication - Special issue on speech and emotion
The production and recognition of emotions in speech: features and algorithms

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
An introduction to variable and feature selection

The Journal of Machine Learning Research

Multimedia summarization in law courts: a clustering-based environment for browsing and consulting judicial folders

ICDM'10 Proceedings of the 10th industrial conference on Advances in data mining: applications and theoretical aspects
Multimedia data mining: state of the art and challenges

Multimedia Tools and Applications
Emotional states in judicial courtrooms: An experimental investigation

Speech Communication
Speaker-independent emotion recognition exploiting a psychologically-inspired binary cascade classification schema

International Journal of Speech Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Thanks to the recent progresses in judicial proceedings management, especially related to the introduction of audio/video recording systems, semantic retrieval is a key challenge. In this context emotion recognition engine, through the analysis of vocal signature of actors involved in judicial proceedings, could provide useful annotations for semantic retrieval of multimedia clips. With respect to the generation of semantic emotional tag in judicial domain, two main contributions are given: (1) the construction of an Italian emotional database for Italian proceedings annotation; (2) the investigation of a hierarchical classification system, based on risk minimization method, able to recognize emotional states from vocal signatures. In order to estimate the degree of affection we compared the proposed classification method with SVM, K-Nearest Neighbors and Naive Bayes, highlighting in terms of classification accuracy, the improvements given by a hierarchical learning approach.