Using multiple data sources to get closer insights into user cost and task performance

Authors:
Tao Lin;Atsumi Imamiya;Xiaoyang Mao
Affiliations:
Sichuan University, 24, South Section 1, Yihuan Road, Chengdu, Sichuan 610065, PR China;Department of Computer Science and Media Engineering, University of Yamanashi, Takeda 4-3-11, Kofu, Yamanashi Prefecture 400-8511, Japan;Department of Computer Science and Media Engineering, University of Yamanashi, Takeda 4-3-11, Kofu, Yamanashi Prefecture 400-8511, Japan
Venue:
Interacting with Computers
Year:
2008

Citing 9
Cited 3

Operator effort and the measurement of heart-rate variability

Human Factors - Cognitive psychophysiology
Spectral analysis of sinus arrhythmia: a measure of mental effort

Human Factors - Cognitive psychophysiology
Evaluating user-computer interaction: a framework

International Journal of Man-Machine Studies
Heart rate variability: indicator of user state as an aid to human-computer interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Toward Machine Emotional Intelligence: Analysis of Affective Physiological State

IEEE Transactions on Pattern Analysis and Machine Intelligence - Graph Algorithms and Computer Vision
To feel or not to feel: the role of affect in human-computer interaction

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Task-evoked pupillary response to mental workload in human-computer interaction

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Current practice in measuring usability: Challenges to usability studies and research

International Journal of Human-Computer Studies
Eye Tracking Methodology: Theory and Practice

Eye Tracking Methodology: Theory and Practice

Identifying relationships between physiological measures and evaluation metrics for 3D interaction techniques

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Student progress assessment with the help of an intelligent pupil analysis system

Engineering Applications of Artificial Intelligence
Automatic Cognitive Load Classification Using High-Frequency Interaction Events: An Exploratory Study

International Journal of Technology and Human Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This pilot study explores the use of combining multiple data sources (subjective, physical, physiological, and eye tracking) in understanding user cost and behavior. Specifically, we show the efficacy of such objective measurements as heart rate variability (HRV), and pupillary response in evaluating user cost in game environments, along with subjective techniques, and investigate eye and hand behavior at various levels of user cost. In addition, a method for evaluating task performance at the micro-level is developed by combining eye and hand data. Four findings indicate the great potential value of combining multiple data sources to evaluate interaction: first, spectral analysis of HRV in the low frequency band shows significant sensitivity to changes in user cost, modulated by game difficulty-the result is consistent with subjective ratings, but pupillary response fails to accord with user cost in this game environment; second, eye saccades seem to be more sensitive to user cost changes than eye fixation number and duration, or scanpath length; third, a composite index based on eye and hand movements is developed, and it shows more sensitivity to user cost changes than a single eye or hand measurement; finally, timeline analysis of the ratio of eye fixations to mouse clicks demonstrates task performance changes and learning effects over time. We conclude that combining multiple data sources has a valuable role in human-computer interaction (HCI) evaluation and design.