Eye activity as a measure of human mental effort in HCI

Authors:
Siyuan Chen;Julien Epps;Natalie Ruiz;Fang Chen
Affiliations:
The University of New South Wales, Sydney, Australia;The University of New South Wales/National ICT Australia(NICTA), Sydney, Australia;National ICT Australia(NICTA), Sydney, Australia;National ICT Australia(NICTA), Sydney, Australia
Venue:
Proceedings of the 16th international conference on Intelligent user interfaces
Year:
2011

Citing 2
Cited 6

Cognitive load in ecommerce applications: measurement and effects on user satisfaction

Advances in Human-Computer Interaction
Eye Movement as Indicators of Mental Workload to Trigger Adaptive Automation

FAC '09 Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009

Pupillary response based cognitive workload measurement under luminance changes

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
A comparison of four methods for cognitive load measurement

Proceedings of the 23rd Australian Computer-Human Interaction Conference
Exploiting eye tracking in advanced e-learning systems

Proceedings of the 13th International Conference on Computer Systems and Technologies
Automatic and continuous user task analysis via eye activity

Proceedings of the 2013 international conference on Intelligent user interfaces
Indexing cognitive workload based on pupillary response under luminance and emotional changes

Proceedings of the 2013 international conference on Intelligent user interfaces
Automatic classification of eye activity for cognitive load measurement with emotion interference

Computer Methods and Programs in Biomedicine

Quantified Score

Hi-index	0.00

Visualization

Abstract

The measurement of a user's mental effort is a problem whose solutions may have important applications to adaptive interfaces and interface evaluation. Previous studies have empirically shown links between eye activity and mental effort; however these have usually investigated only one class of eye activity on tasks atypical of HCI. This paper reports on research into eight eye activity based features, spanning eye blink, pupillary response and eye movement information, for real time mental effort measurement. Results from an experiment conducted using a computer-based training system show that the three classes of eye features are capable of discriminating different cognitive load levels. Correlation analysis between various pairs of features suggests that significant improvements in discriminating different effort levels can be made by combining multiple features. This shows an initial step towards a real-time cognitive load measurement system in human-computer interaction.