Automatic refinement of an expressive speech corpus assembling subjective perception and automatic classification

Authors:
Ignasi Iriondo;Santiago Planet;Joan-Claudi Socoró;Elisa Martínez;Francesc Alías;Carlos Monzo
Affiliations:
GPMM - Grup de Recerca en Processament Multimodal, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, C/Quatre Camins 2, 08022 Barcelona, Spain;GPMM - Grup de Recerca en Processament Multimodal, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, C/Quatre Camins 2, 08022 Barcelona, Spain;GPMM - Grup de Recerca en Processament Multimodal, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, C/Quatre Camins 2, 08022 Barcelona, Spain;GPMM - Grup de Recerca en Processament Multimodal, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, C/Quatre Camins 2, 08022 Barcelona, Spain;GPMM - Grup de Recerca en Processament Multimodal, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, C/Quatre Camins 2, 08022 Barcelona, Spain;GPMM - Grup de Recerca en Processament Multimodal, Enginyeria i Arquitectura La Salle, Universitat Ramon Llull, C/Quatre Camins 2, 08022 Barcelona, Spain
Venue:
Speech Communication
Year:
2009

Citing 14
Cited 3

Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Emotional speech: towards a new generation of databases

Speech Communication - Special issue on speech and emotion
Vocal communication of emotion: a review of research paradigms

Speech Communication - Special issue on speech and emotion
The production and recognition of emotions in speech: features and algorithms

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Developments in Corpus-Based Speech Synthesis: Approaching Natural Conversational Speech

IEICE - Transactions on Information and Systems
2005 Special Issue: Beyond emotion archetypes: Databases for emotion modelling using neural networks

Neural Networks - Special issue: Emotion and brain
2005 Special Issue: Challenges in real-life emotion annotation and machine learning based detection

Neural Networks - Special issue: Emotion and brain
Ensemble methods for spoken emotion recognition in call-centres

Speech Communication
An evaluation of the robustness of existing supervised machine learning approaches to the classification of emotions in speech

Speech Communication
Validation of an expressive speech corpus by mapping automatic classification to subjective evaluation

IWANN'07 Proceedings of the 9th international work conference on Artificial neural networks
Objective and subjective evaluation of an expressive speech corpus

NOLISP'07 Proceedings of the 2007 international conference on Advances in nonlinear speech processing
The IBM expressive text-to-speech synthesis system for American English

IEEE Transactions on Audio, Speech, and Language Processing
An objective and subjective study of the role of semantics and prosodic features in building corpora for emotional TTS

IEEE Transactions on Audio, Speech, and Language Processing
Generating expressive speech for storytelling applications

IEEE Transactions on Audio, Speech, and Language Processing

Statistical analysis of complementary spectral features of emotional speech in Czech and Slovak

TSD'11 Proceedings of the 14th international conference on Text, speech and dialogue
Microintonation analysis of emotional speech

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Comparison of complementary spectral features of emotional speech for german, czech, and slovak

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an automatic system able to enhance expressiveness in speech corpora recorded from acted or stimulated speech. The system is trained with the results of a subjective evaluation carried out on a reduced set of the original corpus. Once the system has been trained, it is able to check the complete corpus and perform an automatic pruning of the unclear utterances, i.e. with expressive styles which are different from the intended corpus. The content which most closely matches the subjective classification remains in the resulting corpus. An expressive speech corpus in Spanish, designed and recorded for speech synthesis purposes, has been used to test the presented proposal. The automatic refinement has been applied to the whole corpus and the result has been validated with a second subjective test.