Using language complexity to measure cognitive load for adaptive interaction design

Authors:
M. Asif Khawaja;Fang Chen;Nadine Marcus
Affiliations:
NIcta/School of Computer Science, University of New South Wales, Sydney, Australia;Nicta/University of New South Wales, Sydney, Australia;School of Computer Science, University of New South Wales, Sydney, Australia
Venue:
Proceedings of the 15th international conference on Intelligent user interfaces
Year:
2010

Citing 6
Cited 1

Interpreting symptoms of cognitive load in speech input

UM '99 Proceedings of the seventh international conference on User modeling
Multimedia Learning

Multimedia Learning
The Emotion Mouse

Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I - Volume I
Exploiting prosodic structuring of coverbal gesticulation

Proceedings of the 6th international conference on Multimodal interfaces
Using linguistic features to measure presence in computer-mediated communication

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Potential speech features for cognitive load measurement

OZCHI '07 Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces

Multimodal behavior and interaction as indicators of cognitive load

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

An adaptive interaction system, which is aware of the users' current cognitive load, can change its response, presentation and interaction flow to improve users' experience and their task performance. In this paper, we propose a novel speech content analysis approach for measuring users' cognitive load, based on their language and dialogue complexity. We have analysed the transcribed speech of operators working in computerized incident control rooms and involved in highly complex bushfire management tasks in Australia. The resulting patterns of language complexity show significant differences between the speech from cognitively low load and high load tasks. We also discuss the value of using this approach of cognitive load measurement for user interface evaluation and interaction design improvement.