High-order contrasts for independent component analysis
Neural Computation
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A Bayesian Computer Vision System for Modeling Human Interactions
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning Subjective Adjectives from Corpora
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
StressCam: non-contact measurement of users' emotional states through thermal imaging
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Learning extraction patterns for subjective expressions
EMNLP '03 Proceedings of the 2003 conference on Empirical methods in natural language processing
Emotion Recognition Based on Joint Visual and Audio Cues
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Recognizing contextual polarity in phrase-level sentiment analysis
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Emotions from text: machine learning for text-based emotion prediction
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Learning to identify emotions in text
Proceedings of the 2008 ACM symposium on Applied computing
ACM Transactions on Applied Perception (TAP)
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Head Pose Estimation in Computer Vision: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
Multimodal subjectivity analysis of multiparty conversation
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
SemEval-2007 task 14: affective text
SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Audio-Visual Classification and Fusion of Spontaneous Affective Data in Likelihood Space
ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Learning word vectors for sentiment analysis
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Towards multimodal sentiment analysis: harvesting opinions from the web
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Interrelation Between Speech and Facial Gestures in Emotional Utterances: A Single Subject Study
IEEE Transactions on Audio, Speech, and Language Processing
| Hi-index | 0.00 |
In this paper, we explore a multimodal approach to sensing affective state during exposure to visual narratives. Using four different modalities, consisting of visual facial behaviors, thermal imaging, heart rate measurements, and verbal descriptions, we show that we can effectively predict changes in human affect. Our experiments show that these modalities complement each other, and illustrate the role played by each of the four modalities in detecting human affect.