Emotion recognition with consideration of facial expression and physiological signals

Authors:
Chuan-Yu Chang;Jeng-Shiun Tsai;Chi-Jane Wang;Pau-Choo Chung
Affiliations:
Department of Computer and Communication Engineering, National Yunlin University of Science & Technology, Taiwan; ;Department of Nursing, National Cheng Kung University, Taiwan;Department of Electrical Engineering, National Cheng Kung University, Taiwan
Venue:
CIBCB'09 Proceedings of the 6th Annual IEEE conference on Computational Intelligence in Bioinformatics and Computational Biology
Year:
2009

Citing 7
Cited 1

Automatic recognition and analysis of human faces and facial expressions: a survey

Pattern Recognition
Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
Toward Machine Emotional Intelligence: Analysis of Affective Physiological State

IEEE Transactions on Pattern Analysis and Machine Intelligence - Graph Algorithms and Computer Vision
Facial Expression Recognition Based on Gabor Wavelet Transformation and Elastic Templates Matching

ICIG '04 Proceedings of the Third International Conference on Image and Graphics
Parametric models for facial features segmentation

Signal Processing
Recognition of facial expressions using Gabor wavelets and learning vector quantization

Engineering Applications of Artificial Intelligence
Adaptive color space switching based approach for face tracking

ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II

Physiological emotion analysis using support vector regression

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

An emotion recognition system with consideration of facial expression and physiological signals is proposed in this paper. A specific designed mood induction experiment is performed to collect facial expressing images and physiological signals of subjects. We detected 14 feature points and extracted 12 facial features from facial expression images. Meanwhile, we measure the skin conductivity, finger temperature and heart rate from the subject. Both facial and physiological features are adopted to train the classifiers. Two learning vector quantization (LVQ) neural networks were applied to classify four emotions: love, joy, surprise and fear. Experimental results show the proposed recognition system is able to identify four emotions by facial expressions, physiological signals, and both of them.