EMPATH: face, emotion, and gender recognition using holons
NIPS-3 Proceedings of the 1990 conference on Advances in neural information processing systems 3
Agents that reduce work and information overload
Communications of the ACM
The role of emotion in believable agents
Communications of the ACM
Affective computing
Panel on affect and emotion in the user interface
IUI '98 Proceedings of the 3rd international conference on Intelligent user interfaces
Motives for intelligent agents: computational scripts for emotion concepts
SCAI '97 Proceedings of the sixth Scandinavian conference on Artificial intelligence
Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I - Volume I
Neural Network-Based Face Detection
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
SmartCar: Detecting Driver Stress
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
A neural network model of micro- and macroprosody
A neural network model of micro- and macroprosody
Physiological data feedback for application in distance education
Proceedings of the 2001 workshop on Perceptive user interfaces
Speech dialogue with facial displays: multimodal human-computer conversation
ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Multimodal affective driver interfaces for future cars
Proceedings of the tenth ACM international conference on Multimedia
StressCam: non-contact measurement of users' emotional states through thermal imaging
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Combining eye movements and collaborative filtering for proactive information retrieval
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Facial Expression Analysis in E-Learning Systems " The Problems and Feasibility
ICALT '05 Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies
Toward multimodal fusion of affective cues
Proceedings of the 1st ACM international workshop on Human-centered multimedia
Gaze-X: adaptive affective multimodal interface for single-user office scenarios
Proceedings of the 8th international conference on Multimodal interfaces
Interacting with human physiology
Computer Vision and Image Understanding
Using noninvasive wearable computers to recognize human emotions from physiological signals
EURASIP Journal on Applied Signal Processing
Affective multimodal mirror: sensing and eliciting laughter
Proceedings of the international workshop on Human-centered multimedia
Automatic temporal segment detection and affect recognition from face and body display
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
A bidirectional haptic communication framework and an authoring tool for an instant messenger
ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 3
Affective cognitive modeling for autonomous agents based on Scherer's emotion theory
KI'06 Proceedings of the 29th annual German conference on Artificial intelligence
Affective user modeling for adaptive intelligent user interfaces
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Affectively intelligent and adaptive car interfaces
Information Sciences: an International Journal
Gaze-X: adaptive, affective, multimodal interface for single-user office scenarios
ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Core aspects of affective metacognitive user models
UMAP'11 Proceedings of the 19th international conference on Advances in User Modeling
Toward a software product line for affective-driven self-adaptive systems
Proceedings of the 2013 International Conference on Software Engineering
Exploiting unconscious user signals in multimodal human-computer interaction
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012
Affective and cognitive design for mass personalization: status and prospect
Journal of Intelligent Manufacturing
Towards estimating computer users' mood from interaction behaviour with keyboard and mouse
Frontiers of Computer Science: Selected Publications from Chinese Universities
| Hi-index | 0.00 |
Human intelligence is being increasingly redefined to include the all-encompassing effect of emotions upon what used to be considered 'pure reason'. With the recent progress of research in computer vision, speech/prosody recognition, and bio-feedback, real-time recognition of affect will enhance human-computer interaction considerably, as well as assist further progress in the development of new emotion theories.In this article, we describe how affect, moods and emotions closely interact with cognition and how affect and emotion are the quintessential multimodal processes in humans. We then propose an adaptive system architecture designed to sense the user's emotional and affective states via three multimodal subsystems (V, K, A): namely (1) the Visual (from facial images and videos), (2) Kinesthetic (from autonomic nervous system (ANS) signals), and (3) Auditory (from speech). The results of the system sensing are then integrated into the multimodal perceived multimodal anthropomorphic interface agent then adapts its interface by responding most appropriately to the current emotional states of its user, and provides intelligent multi-modal feedback to the user.