Dual-task performance in multimodal human-computer interaction: a psychophysiological perspective

Authors:
Domen Novak;Matjaz Mihelj;Marko Munih
Affiliations:
Faculty of Electrical Engineering, University of Ljubljana, Ljubljana, Slovenia 1000;Faculty of Electrical Engineering, University of Ljubljana, Ljubljana, Slovenia 1000;Faculty of Electrical Engineering, University of Ljubljana, Ljubljana, Slovenia 1000
Venue:
Multimedia Tools and Applications
Year:
2012

Citing 7
Cited 0

Is word recognition automatic? a cognitive-anatomical approach

Journal of Cognitive Neuroscience
Neuro-cognitively inspired haptic user interfaces

Multimedia Tools and Applications
Concurrent performance of military and robotics tasks and effects of cueing in a simulated multi-tasking environment

Presence: Teleoperators and Virtual Environments
Distribution of cognitive load in Web search

Journal of the American Society for Information Science and Technology
Predicting task difficulty for different task types

Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 47
Psychophysiological responses to different levels of cognitive and physical workload in haptic interaction

Robotica
Adaptation in virtual environments: conceptual framework and user models

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper examines the psychophysiological effects of mental workload in single-task and dual-task human-computer interaction. A mental arithmetic task and a manual error correction task were performed both separately and concurrently on a computer using verbal and haptic input devices. Heart rate, skin conductance, respiration and peripheral skin temperature were recorded in addition to objective performance measures and self-report questionnaires. Analysis of psychophysiological responses found significant changes from baseline for both single-task and dual-task conditions. There were also significant psychophysiological differences between the mental arithmetic task and the manual error correction task, but no differences in questionnaire results. Additionally, there was no significant psychophysiological difference between performing only the mental arithmetic task and performing both tasks at once. These findings suggest that psychophysiological measures respond differently to different types of tasks and that they do not always agree with performance or with participants' subjective feelings.