Cognitive Load Measurement from User's Linguistic Speech Features for Adaptive Interaction Design

Authors:
M. Asif Khawaja;Fang Chen;Christine Owen;Gregory Hickey
Affiliations:
Nicta, ATP, Sydney, Australia and School of Computer Science and Engineering, UNSW, Sydney, Australia;Nicta, ATP, Sydney, Australia and School of Computer Science and Engineering, UNSW, Sydney, Australia and School of Electrical Engineering and Telecommunication, UNSW, Sydney, Australia;University of Tasmania, Hobart, Australia;University of Tasmania, Hobart, Australia
Venue:
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Year:
2009

Citing 6
Cited 4

Interpreting symptoms of cognitive load in speech input

UM '99 Proceedings of the seventh international conference on User modeling
Multimedia Learning

Multimedia Learning
Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study

UM '01 Proceedings of the 8th International Conference on User Modeling 2001
The Emotion Mouse

Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I - Volume I
Using linguistic features to measure presence in computer-mediated communication

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Potential speech features for cognitive load measurement

OZCHI '07 Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces

Freeform pen-input as evidence of cognitive load and expertise

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Multimodal behavior and interaction as indicators of cognitive load

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
Neural and speech indicators of cognitive load for sudoku game interfaces

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part I
Automatic Cognitive Load Classification Using High-Frequency Interaction Events: An Exploratory Study

International Journal of Technology and Human Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

An adaptive interaction system, which is aware of the user's current cognitive load (CL), can change its response, presentation and flow of interaction material accordingly, to improve user's experience and performance. We present a speech content analysis approach to CL measurement, which employs users' linguistic features of speech to determine their experienced CL level. We show analyses of several linguistic features, extracted from speech of personnel working in computerized incident control rooms and involved in highly complex bushfire management tasks in Australia. We present the results of linguistic features showing significant differences between the speech from the cognitively low load and high load tasks. We also discuss how the method may be used for user interface evaluation and interaction design improvement.