Unobtrusive multimodal emotion detection in adaptive interfaces: speech and facial expressions

Authors:
Khiet P. Truong;David A. van Leeuwen;Mark A. Neerincx
Affiliations:
TNO Human Factors, Dept. of Human Interfaces, Soesterberg, The Netherlands;TNO Human Factors, Dept. of Human Interfaces, Soesterberg, The Netherlands;TNO Human Factors, Dept. of Human Interfaces, Soesterberg, The Netherlands
Venue:
FAC'07 Proceedings of the 3rd international conference on Foundations of augmented cognition
Year:
2007

Citing 7
Cited 7

Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
Bimodal Emotion Recognition

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction

Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Multimodal affect recognition in learning environments

Proceedings of the 13th annual ACM international conference on Multimedia
Emotion Recognition Based on Joint Visual and Audio Cues

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
Piecing together the emotion jigsaw

MLMI'04 Proceedings of the First international conference on Machine Learning for Multimodal Interaction

Affective multimodal mirror: sensing and eliciting laughter

Proceedings of the international workshop on Human-centered multimedia
Adaptive Interfaces in Driving

FAC '09 Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009
Modeling the Cognitive Task Load and Performance of Naval Operators

FAC '09 Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009
Measuring Cognitive Workload in Non-military Scenarios Criteria for Sensor Technologies

FAC '09 Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009
Getting a Grip on Emotions in Negotiations: The Possibilities of ICT

WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 03
Affective Artificial Intelligence in Education: From Detection to Adaptation

Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling
Measuring cognitive task load on a naval ship: implications of a real world environment

FAC'07 Proceedings of the 3rd international conference on Foundations of augmented cognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Two unobtrusive modalities for automatic emotion recognition are discussed: speech and facial expressions. First, an overview is given of emotion recognition studies based on a combination of speech and facial expressions. We will identify difficulties concerning data collection, data fusion, system evaluation and emotion annotation that one is most likely to encounter in emotion recognition research. Further, we identify some of the possible applications for emotion recognition such as health monitoring or e-learning systems. Finally, we will discuss the growing need for developing agreed standards in automatic emotion recognition research.