Applied multivariate techniques
Applied multivariate techniques
Coding, Analysis, Interpretation, and Recognition of Facial Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Affective computing
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion
International Journal of Computer Vision
Digital Image Processing
Interacting with Virtual Humans through Body Actions
IEEE Computer Graphics and Applications
Face Recognition Using Active Appearance Models
ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Facial expression recognition: a clustering-based approach
Pattern Recognition Letters
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Face recognition with visible and thermal infrared imagery
Computer Vision and Image Understanding - Special issue on Face recognition
Facial expression recognition from video sequences: temporal and static modeling
Computer Vision and Image Understanding - Special issue on Face recognition
Pattern Classification (2nd Edition)
Pattern Classification (2nd Edition)
Guide to Biometrics
Analysis of emotion recognition using facial expressions, speech and multimodal information
Proceedings of the 6th international conference on Multimodal interfaces
Recent advances in visual and infrared face recognition: a review
Computer Vision and Image Understanding
StressCam: non-contact measurement of users' emotional states through thermal imaging
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Multimodal Face Recognition: Combination of Geometry with Physiological Information
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
8D-THERMO CAM: Combination of Geometry with Physiological Information for Face Recognition
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Image Processing - Principles and Applications
Image Processing - Principles and Applications
ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Real-time estimation of emotional experiences from facial expressions
Interacting with Computers
Using noninvasive wearable computers to recognize human emotions from physiological signals
EURASIP Journal on Applied Signal Processing
Detecting stress during real-world driving tasks using physiological sensors
IEEE Transactions on Intelligent Transportation Systems
HeatWave: thermal imaging for surface user interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Emotion recognition using hidden Markov models from facial temperature sequence
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Towards sensing the influence of visual narratives on human affect
Proceedings of the 14th ACM international conference on Multimodal interaction
Drunk person identification using thermal infrared images
International Journal of Electronic Security and Digital Forensics
Eye localization from infrared thermal images
MPRSS'12 Proceedings of the First international conference on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction
Eye localization from thermal infrared images
Pattern Recognition
Thermal imaging for affect detection
Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments
Perspectives on the evaluation of affective quality in social software
International Journal of Web Based Communities
Hi-index | 0.01 |
Earlier researchers were able to extract the transient facial thermal features from thermal infrared images (TIRIs) to make binary distinctions between the expressions of affective states. However, effective human-computer interaction would require machines to distinguish between the subtle facial expressions of affective states. This work, for the first time, attempts to use the transient facial thermal features for recognizing a much wider range of facial expressions. A database of 324 time-sequential, visible-spectrum, and thermal facial images was developed representing different facial expressions from 23 participants in different situations. A novel facial thermal feature extraction, selection, and classification approach was developed and invoked on various Gaussian mixture models constructed using: neutral and pretended happy and sad faces, faces with multiple positive and negative facial expressions, faces with neutral and six (pretended) basic facial expressions, and faces with evoked happiness, sadness, disgust, and anger. This work demonstrates that (1) infrared imaging can be used to observe the affective-state-specific facial thermal variations, (2) pixel-grey level analysis of TIRIs can help localise significant facial thermal feature points along the major facial muscles, and (3) cluster-analytic classification of transient thermal features can help distinguish between the facial expressions of affective states in an optimized eigenspace of input thermal feature vectors. The observed classification results exhibited influence of a Gaussian mixture model's structure on classifier-performance. The work also unveiled some pertinent aspects of future research on the use of facial thermal features in automated facial expression classification and affect recognition.