Multimodal Human Emotion/Expression Recognition
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Affective computing: challenges
International Journal of Human-Computer Studies - Application of affective computing in humanComputer interaction
Visual Prosody: Facial Movements Accompanying Speech
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Analysis of emotion recognition using facial expressions, speech and multimodal information
Proceedings of the 6th international conference on Multimodal interfaces
Affective Student Modeling Based on Microphone and Keyboard User Actions
ICALT '06 Proceedings of the Sixth IEEE International Conference on Advanced Learning Technologies
Visual affect recognition
Object oriented architecture for affective multimodal e-learning interfaces
Intelligent Decision Technologies
Automatic generation of emotions in tutoring agents for affective e-learning in medical education
Expert Systems with Applications: An International Journal
Multimodal object oriented user interfaces in mobile affective interaction
Multimedia Tools and Applications
Hi-index | 0.00 |
In this paper, we present and discuss two empirical studies that we have conducted involving human subjects and human observers concerning the recognition of emotions from audio-lingual and visual-facial modalities. Many researchers agree that these modalities are complementary to each other and that the combination of the two can improve the accuracy in affective user models. However, there is a shortage of research in empirical work concerning the strengths and weaknesses of each modality so that more accurate recognizers can be built. In our research, we have investigated the recognition of emotions from the above mentioned modalities with respect to 6 basic emotional states, namely happiness,sadness, surprise, angerand disgustas well as the emotionless state which we refer to as neutral. We have found that certain states such as neutral happiness and surprise are more clearly recognized from the visual-facial modality whereas sadness and disgust are more clearly recognized from the audio-lingual modality.