Towards emotional interaction: using movies to automatically learn users' emotional states

Authors:
Eva Oliveira;Mitchel Benovoy;Nuno Ribeiro;Teresa Chambe
Affiliations:
Digital Games Research Centre, Polytechnic Institute of Cávado and Ave, Barcelos and LaSIGE, University of Lisbon, FCUL, Lisbon, Portugal;Center for Intelligent Machines, McGill University, Montreal, Quebec, Canada;Centro de Estudos e Recursos Multimediáticos, Universidade Fernando Pessoa;LaSIGE, University of Lisbon, FCUL, Lisbon, Portugal
Venue:
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I
Year:
2011

Citing 10
Cited 4

Toward Machine Emotional Intelligence: Analysis of Affective Physiological State

IEEE Transactions on Pattern Analysis and Machine Intelligence - Graph Algorithms and Computer Vision
Discrete-Time Signal Processing

Discrete-Time Signal Processing
The sensual evaluation instrument: developing an affective evaluation tool

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Human-Computer Interaction (3rd Edition)

Human-Computer Interaction (3rd Edition)
Comparing Two Emotion Models for Deriving Affective States from Physiological Data

Affect and Emotion in Human-Computer Interaction
Emotion Recognition Based on Physiological Changes in Music Listening

IEEE Transactions on Pattern Analysis and Machine Intelligence
Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User's Physiological Emotional Responses

ISM '08 Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia
Short-term emotion assessment in a recall paradigm

International Journal of Human-Computer Studies
Ifelt: accessing movies through our emotions

Proceddings of the 9th international interactive conference on Interactive television

Being happy, healthy and whole watching movies that affect our emotions

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
MovieClouds: content-based overviews and exploratory browsing of movies

Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments
Going Through the Clouds: Search Overviews and Browsing of Movies

Proceeding of the 16th International Academic MindTrek Conference
Content-based search overviews and exploratory browsing of movies with MovieClouds

International Journal of Advanced Media and Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

The HCI community is actively seeking novel methodologies to gain insight into the user's experience during interaction with both the application and the content. We propose an emotional recognition engine capable of automatically recognizing a set of human emotional states using psychophysiological measures of the autonomous nervous system, including galvanic skin response, respiration, and heart rate. A novel pattern recognition system, based on discriminant analysis and support vector machine classifiers is trained using movies' scenes selected to induce emotions ranging from the positive to the negative valence dimension, including happiness, anger, disgust, sadness, and fear. In this paper we introduce an emotion recognition system and evaluate its accuracy by presenting the results of an experiment conducted with three physiologic sensors.