Towards estimating computer users' mood from interaction behaviour with keyboard and mouse

Authors:
Iftikhar Ahmed Khan;Willem-Paul Brinkman;Robert Hierons
Affiliations:
Department of Computer Software Engineering, University of Engineering & Technology, Mardan, Pakistan 23200;Interactive Intelligence Group, Delft University of Technology, Delft, the Netherlands 2628B;Department of Information Systems and Computing, Brunel University, West London, UK UB83PH
Venue:
Frontiers of Computer Science: Selected Publications from Chinese Universities
Year:
2013

Citing 13
Cited 0

Affective computing

Affective computing
Structured programmers learning object-oriented programming: cognitive considerations

ACM SIGCHI Bulletin
The Psychology of Human-Computer Interaction

The Psychology of Human-Computer Interaction
MAUI: a multimodal affective user interface

Proceedings of the tenth ACM international conference on Multimedia
Emotion in human-computer interaction

The human-computer interaction handbook
The Acquisition and Use of Interaction Behavior Models

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
A computer game using galvanic skin response

ICEC '03 Proceedings of the second international conference on Entertainment computing
Communicating emotions in online chat using physiological sensors and animated text

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Tabletop interaction: research alert

Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Severity and impact of computer user frustration: A comparison of student and workplace users

Interacting with Computers
Towards Improving Visual-Facial Emotion Recognition through Use of Complementary Keyboard-Stroke Pattern Information

ITNG '08 Proceedings of the Fifth International Conference on Information Technology: New Generations
Emotion recognition from speech by combining databases and fusion of classifiers

TSD'10 Proceedings of the 13th international conference on Text, speech and dialogue
Do moods affect programmers’ debug performance?

Cognition, Technology and Work

Quantified Score

Hi-index	0.00

Visualization

Abstract

The purpose of this exploratory research was to study the relationship between the mood of computer users and their use of keyboard and mouse to examine the possibility of creating a generic or individualized mood measure. To examine this, a field study (n = 26) and a controlled study (n = 16) were conducted. In the field study, interaction data and self-reported mood measurements were collected during normal PC use over several days. In the controlled study, participants worked on a programming task while listening to high or low arousing background music. Besides subjective mood measurement, galvanic skin response (GSR) data was also collected. Results found no generic relationship between the interaction data and the mood data. However, the results of the studies found significant average correlations between mood measurement and personalized regression models based on keyboard and mouse interaction data. Together the results suggest that individualized mood prediction is possible from interaction behaviour with keyboard and mouse.