Crawling to improve multimodal emotion detection

Authors:
Diego R. Cueva;Rafael A. M. Gonçalves;Fábio Cozman;Marcos R. Pereira-Barretto
Affiliations:
Departamento de Engenharia Mecatrônica e Sistema Mecânicos, Escola Politécnica da Universidade de São Paulo (EPUSP), São Paulo, SP, Brazil;Departamento de Engenharia Mecatrônica e Sistema Mecânicos, Escola Politécnica da Universidade de São Paulo (EPUSP), São Paulo, SP, Brazil;Departamento de Engenharia Mecatrônica e Sistema Mecânicos, Escola Politécnica da Universidade de São Paulo (EPUSP), São Paulo, SP, Brazil;Departamento de Engenharia Mecatrônica e Sistema Mecânicos, Escola Politécnica da Universidade de São Paulo (EPUSP), São Paulo, SP, Brazil
Venue:
MICAI'11 Proceedings of the 10th international conference on Artificial Intelligence: advances in Soft Computing - Volume Part II
Year:
2011

Citing 5
Cited 1

2005 Special Issue: A systems approach to appraisal mechanisms in emotion

Neural Networks - Special issue: Emotion and brain
2005 Special Issue: A systems approach to appraisal mechanisms in emotion

Neural Networks - Special issue: Emotion and brain
EmoVoice -- A Framework for Online Recognition of Emotions from Voice

PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Towards context aware emotional intelligence in machines: computing contextual appropriateness of affective states

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
EmotionSense: a mobile phones based adaptive platform for experimental social psychology research

Proceedings of the 12th ACM international conference on Ubiquitous computing

Consistent but modest: a meta-analysis on unimodal and multimodal affect detection accuracies from 30 studies

Proceedings of the 14th ACM international conference on Multimodal interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper demonstrates multimodal fusion of emotion sensory data in realistic scenarios of relatively long human-machine interactions. Fusion, combining voice and facial expressions, has been enhanced with semantic information retrieved from Internet social networks, resulting in more accurate determination of the conveyed emotion.