Subjective measurement of workload related to a multimodal interaction task: NASA-TLX vs. workload profile

  • Authors:
  • Dominique Fréard;Eric Jamet;Olivier Le Bohec;Gérard Poulain;Valérie Botherel

  • Affiliations:
  • Université Rennes 2, Rennes, France and France Telecom, Lannion cedex, France;Université Rennes 2, Rennes, France;Université Rennes 2, Rennes, France;France Telecom, Lannion cedex, France;France Telecom, Lannion cedex, France

  • Venue:
  • HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

This paper addresses workload evaluation in the framework of a multimodal application. Two multidimensional subjective workload rating instruments are compared. The goal is to analyze the diagnostics obtained on four implementations of an applicative task. In addition, an Automatic Speech Recognition (ASR) error was introduced in one of the two trials. Eighty subjects participated in the experiment. Half of them rated their subjective workload with NASA-TLX and the other half rated it with Workload Profile (WP) enriched with two stress-related scales. Discriminant and variance analyses revealed a better sensitivity with WP. The results obtained with this instrument led to hypotheses on the cognitive activities of the subjects during interaction. Furthermore, WP permitted us to classify two strategies offered for error recovery. We conclude that WP is more informative for the task tested. WP seems to be a better diagnostic instrument in multimodal system conception.