IEEE Transactions on Pattern Analysis and Machine Intelligence
Toward Machine Emotional Intelligence: Analysis of Affective Physiological State
IEEE Transactions on Pattern Analysis and Machine Intelligence - Graph Algorithms and Computer Vision
Expectation Propagation for approximate Bayesian inference
UAI '01 Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence
Real-Time, Fully Automatic Upper Facial Feature Tracking
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Mixture of gaussian processes for combining multiple modalities
MCS'05 Proceedings of the 6th international conference on Multiple Classifier Systems
Critic-driven ensemble classification
IEEE Transactions on Signal Processing
Gaze-X: adaptive affective multimodal interface for single-user office scenarios
Proceedings of the 8th international conference on Multimodal interfaces
Automatic prediction of frustration
International Journal of Human-Computer Studies
Observer annotation of affective display and evaluation of expressivity: face vs. face-and-body
VisHCI '06 Proceedings of the HCSNet workshop on Use of vision in human-computer interaction - Volume 56
Affective multimodal mirror: sensing and eliciting laughter
Proceedings of the international workshop on Human-centered multimedia
Visual inference of human emotion and behaviour
Proceedings of the 9th international conference on Multimodal interfaces
How to distinguish posed from spontaneous smiles using geometric features
Proceedings of the 9th international conference on Multimodal interfaces
Modeling parallel and reactive empathy in virtual agents: an inductive approach
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
Handling uncertainty in multimodal pervasive computing applications
Computer Communications
Interaction Reproducing Model: A Model for Giving Supports Appropriate to User State
PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
How people talk when teaching a robot
Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
Mind and Body: Dialogue and Posture for Affect Detection in Learning Environments
Proceedings of the 2007 conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work
Empirically building and evaluating a probabilistic model of user affect
User Modeling and User-Adapted Interaction
Societal impact of a serious game on raising public awareness: the case of FloodSim
Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games
Modeling User Affect from Causes and Effects
UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
Smart cooking support system based on interaction reproducing model
CEA '09 Proceedings of the ACM multimedia 2009 workshop on Multimedia for cooking and eating activities
Toward environment-to-environment (E2E) affective sensitive communication systems
MTDL '09 Proceedings of the first ACM international workshop on Multimedia technologies for distance learning
Detecting user engagement with a robot companion using task and social interaction-based features
Proceedings of the 2009 international conference on Multimodal interfaces
Automatic temporal segment detection and affect recognition from face and body display
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Modeling Task-Based vs. Affect-based Feedback Behavior in Pedagogical Agents: An Inductive Approach
Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling
Unobtrusive multimodal emotion detection in adaptive interfaces: speech and facial expressions
FAC'07 Proceedings of the 3rd international conference on Foundations of augmented cognition
A statistical reasoning system for medication prompting
UbiComp '07 Proceedings of the 9th international conference on Ubiquitous computing
A conceptual framework of affective context-aware interactive learning media
Edutainment'07 Proceedings of the 2nd international conference on Technologies for e-learning and digital entertainment
User Modeling and User-Adapted Interaction
Proceedings of the international conference on Multimedia
Audio-visual spontaneous emotion recognition
ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Gaze-X: adaptive, affective, multimodal interface for single-user office scenarios
ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Emotion recognition using a hierarchical binary decision tree approach
Speech Communication
Affect detection from multichannel physiology during learning sessions with AutoTutor
AIED'11 Proceedings of the 15th international conference on Artificial intelligence in education
CASEMANS '11 Proceedings of the 5th ACM International Workshop on Context-Awareness for Self-Managing Systems
Detecting learner frustration: towards mainstream use cases
ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part II
Modelling empathy in social robotic companions
UMAP'11 Proceedings of the 19th international conference on Advances in User Modeling
AffectAura: an intelligent system for emotional memory
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Thin slices of interaction: predicting users' task difficulty within 60 sec.
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Recognition of vocal emotions from acoustic profile
Proceedings of the International Conference on Advances in Computing, Communications and Informatics
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Proceedings of the 14th ACM international conference on Multimodal interaction
Measuring instant emotions based on facial expressions during computer-based assessment
Personal and Ubiquitous Computing
Image and Vision Computing
Exploiting unconscious user signals in multimodal human-computer interaction
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012
Towards in situ affect detection in mobile devices: a multimodal approach
Proceedings of the 2013 Research in Adaptive and Convergent Systems
Towards affect sensitive and socially perceptive companions
Your Virtual Butler
ACM SIGAPP Applied Computing Review
When Does Disengagement Correlate with Performance in Spoken Dialog Computer Tutoring?
International Journal of Artificial Intelligence in Education - Best of AIED 2011
| Hi-index | 0.00 |
We propose a multi-sensor affect recognition system and evaluate it on the challenging task of classifying interest (or disinterest) in children trying to solve an educational puzzle on the computer. The multimodal sensory information from facial expressions and postural shifts of the learner is combined with information about the learner's activity on the computer. We propose a unified approach, based on a mixture of Gaussian Processes, for achieving sensor fusion under the problematic conditions of missing channels and noisy labels. This approach generates separate class labels corresponding to each individual modality. The final classification is based upon a hidden random variable, which probabilistically combines the sensors. The multimodal Gaussian Process approach achieves accuracy of over 86%, significantly outperforming classification using the individual modalities, and several other combination schemes.