Influence of visual stimuli on evaluation of converted emotional speech by listening tests

Authors:
Jiří Přibil;Anna Přibilová
Affiliations:
Institute of Photonics and Electronics, Academy of Sciences CR, v.v.i., Prague 8, Czech Republic;Institute of Electronics and Photonics, Faculty of Electrical Engineering & Information Technology, Slovak University of Technology, Bratislava, Slovakia
Venue:
COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
Year:
2010

Citing 7
Cited 0

Vocal communication of emotion: a review of research paradigms

Speech Communication - Special issue on speech and emotion
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Spectrum Modification for Emotional Speech Synthesis

Multimodal Signals: Cognitive and Algorithmic Issues
The amount of information on emotional states conveyed by the verbal and nonverbal channels: some perceptual data

Progress in nonlinear speech processing
Harmonic model for female voice emotional synthesis

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
Visual context effects on the perception of musical emotional expressions

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
An emotion space model for recognition of emotions in spoken chinese

ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

Emotional voice conversion is usually evaluated by subjective listening tests. In our experiment, the sentences of emotionally converted speech were evaluated by the classical listening test accompanied by visual stimuli of affective pictures with emotional content from the International Affective Picture System (IAPS) database. Obtained results for sentences uttered by male and female speakers corresponding to five emotional states (joy, surprise, sadness, anger together with original neutral state) confirm our working hypothesis about influence of visual stimuli on the speech emotion evaluation process.