Emotion recognition using hidden Markov models from facial temperature sequence

Authors:
Zhilei Liu;Shangfei Wang
Affiliations:
Key Lab of Computing and Communicating Software of AnHui Province, School of Computer Science and Technology, University of Science and Technology of China, HeFei, AnHui, P.R. China;Key Lab of Computing and Communicating Software of AnHui Province, School of Computer Science and Technology, University of Science and Technology of China, HeFei, AnHui, P.R. China
Venue:
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Year:
2011

Citing 6
Cited 3

StressCam: non-contact measurement of users' emotional states through thermal imaging

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Visual learning of texture descriptors for facial expression recognition in thermal imagery

Computer Vision and Image Understanding
Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature

ACM Transactions on Applied Perception (TAP)
Facial expression recognition for speaker using thermal image processing and speech recognition system

ACS'10 Proceedings of the 10th WSEAS international conference on Applied computer science
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications

IEEE Transactions on Affective Computing
A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference

IEEE Transactions on Multimedia

Are you cool enough for Texas Hold'Em Poker?

Proceedings of the 2012 ACM Conference on Ubiquitous Computing
"FaceLight": potentials and drawbacks of thermal imaging to infer driver stress

Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Eye localization from thermal infrared images

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an emotion recognition from facial temporal sequence has been proposed. Firstly, the temperature difference histogram features and five statistical features are extracted from the facial temperature difference matrix of each difference frame in the data sequences. Then the discrete Hidden Markov Models are used as the classifier for each feature. In which, a feature selection strategy based on the recognition results in the training set is introduced. Finally, the results of the experiments on the samples of the USTC-NVIE database demonstrate the effectiveness of our method. Besides, the experiment results also demonstrate that the temperature information of the forehead is more useful than that of the other regions in emotion recognition and understanding, which is consistent with some related research results.