Manipulating stress and cognitive load in conversational interactions with a multimodal system for crisis management support

Authors:
Andreea Niculescu;Yujia Cao;Anton Nijholt
Affiliations:
Human Media Interaction, University of Twente, Enschede, The Netherlands;Human Media Interaction, University of Twente, Enschede, The Netherlands;Human Media Interaction, University of Twente, Enschede, The Netherlands
Venue:
COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Year:
2009

Citing 4
Cited 2

Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI)

Natural Language Engineering
Human-centered design meets cognitive load theory: designing interfaces that help people think

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Speech Under Stress: Analysis, Modeling and Recognition

Speaker Classification I
Combining skin conductance and heart rate variability for adaptive automation during simulated IFR flight

EPCE'07 Proceedings of the 7th international conference on Engineering psychology and cognitive ergonomics

Cognitive load and usability analysis of R-MAP for the people who are blind or visual impaired

Proceedings of the 29th ACM international conference on Design of communication
Objective measures, sensors and computational techniques for stress recognition and classification: A survey

Computer Methods and Programs in Biomedicine

Quantified Score

Hi-index	0.00

Visualization

Abstract

The quality assessment of multimodal conversational interfaces is influenced by many factors. Stress and cognitive load are two of most important. In the literature, these two factors are considered as being related and accordingly summarized under the single concept of ‘cognitive demand’. However, our assumption is that even if they are related, these two factors can still occur independently. Therefore, it is essential to control their levels during the interaction in order to determine the impact that each factor has on the perceived conversational quality. In this paper we present preliminary experiments in which we tried to achieve a factor separation by inducing alternating low/high levels of both stress and cognitive load. The stress/cognitive load levels were manipulated by varying task difficulty, information presentation and time pressure. Physiological measurements, performance metrics, as well as subjective reports were deployed to validate the induced stress and cognitive load levels. Results showed that our manipulations were successful for the cognitive load and partly for the stress. The levels of both factors were better indicated by subjective reports and performance metrics than by physiological measurements.