A multimodal database as a background for emotional synthesis, recognition and training in e-learning systems

Authors:
Luigi Anolli;Fabrizia Mantovani;Marcello Mortillaro;Antonietta Vescovo;Alessia Agliati;Linda Confalonieri;Olivia Realdon;Valentino Zurloni;Alessandro Sacchi
Affiliations:
CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy;CESCOM – Centre for Research in Communication Science, University of Milan – Bicocca, Milan, Italy
Venue:
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
Year:
2005

Citing 7
Cited 2

Affective computing

Affective computing
Describing the emotional states that are expressed in speech

Speech Communication - Special issue on speech and emotion
Emotional speech: towards a new generation of databases

Speech Communication - Special issue on speech and emotion
How to find trouble in communication

Speech Communication - Special issue on speech and emotion
Multimodal Human Emotion/Expression Recognition

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
The production and recognition of emotions in speech: features and algorithms

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Probabilistic Combination of Multiple Modalities to Detect Interest

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03

Human-computer affective interaction system research and application based on physiological signals: a survey

CCDC'09 Proceedings of the 21st annual international conference on Chinese control and decision conference
An experimental study on physiological parameters toward driver emotion recognition

EHAWC'07 Proceedings of the 2007 international conference on Ergonomics and health aspects of work with computers

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a multimodal database developed within the EU-funded project MYSELF. The project aims at developing an e-learning platform endowed with affective computing capabilities for the training of relational skills through interactive simulations. The database includes data coming from 34 participants and concerning physiological parameters, vocal nonverbal features, facial expression and posture. Ten different emotions were considered (anger, joy, sadness, fear, contempt, shame, guilt, pride, frustration and boredom), ranging from primary to self-conscious emotions of particular relevance in learning process and interpersonal relationships. Preliminary results and analyses are presented, together with directions for future work.