Multivariate data analysis with readings (2nd ed.)
Multivariate data analysis with readings (2nd ed.)
Spectral analysis of sinus arrhythmia: a measure of mental effort
Human Factors - Cognitive psychophysiology
Affective computing
101 spots, or how do users read menus?
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Heart rate variability: indicator of user state as an aid to human-computer interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The response of eye-movement and pupil size to audio instruction while viewing a moving target
ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
The act of task difficulty and eye-movement frequency for the 'Oculo-motor indices'
ETRA '02 Proceedings of the 2002 symposium on Eye tracking research & applications
Eye tracking in web search tasks: design implications
ETRA '02 Proceedings of the 2002 symposium on Eye tracking research & applications
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Physiological measures of presence in stressful virtual environments
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Psychophysiological indicators of the impact of media quality on users
CHI '01 Extended Abstracts on Human Factors in Computing Systems
International Journal of Human-Computer Studies
Task-evoked pupillary response to mental workload in human-computer interaction
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Do physiological data relate to traditional usability indexes?
OZCHI '05 Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future
Voluntary pupil size change as control in eyes only interaction
Proceedings of the 2008 symposium on Eye tracking research & applications
Invisible eni: using gaze and pupil size to control a game
CHI '08 Extended Abstracts on Human Factors in Computing Systems
EMU in the Car: Evaluating Multimodal Usability of a Satellite Navigation System
Interactive Systems. Design, Specification, and Verification
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends
Effects of Multimodal Feedback on the Usability of Mobile Diet Diary for Older Adults
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
EPCE '09 Proceedings of the 8th International Conference on Engineering Psychology and Cognitive Ergonomics: Held as Part of HCI International 2009
A composite measure for the evaluation of mental workload
ICDHM'07 Proceedings of the 1st international conference on Digital human modeling
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Hi-index | 0.00 |
New technologies are making it possible to provide an enriched view of interaction for researchers using multimodal information. This preliminary study explores the use of multiple information streams in usability evaluation. In the study, easy, medium and difficult versions of a game task were used to vary the levels of mental effort. Multimodal data streams during the three versions were analyzed, including eye tracking, pupil size, hand movement, heart rate variability (HRV) and subjectively reported data. Four findings indicate the potential value of usability evaluations based on multimodal information: First, subjective and physiological measures showed significant sensitivity to task difficulty. Second, different mental workload levels appeared to correlate with eye movement patterns, especially with a combined eye-hand movement measure. Third, HRV showed correlations with saccade speed. Finally, we present a new method using the ratio of eye fixations over mouse clicks to evaluate performance in more detail. These results warrant further investigations and take an initial step toward establishing usability evaluation methods based on multimodal information.