Automatic prediction of frustration

  • Authors:
  • Ashish Kapoor;Winslow Burleson;Rosalind W. Picard

  • Affiliations:
  • Microsoft Research, 1 Microsoft Way, Redmond, WA 98052, USA;Computer Science and Engineering/Arts, Media and Engineering, Arizona State University, 699 S. Mill Avenue, Tempe AZ, 85281, USA;MIT Media Laboratory, 20 Ames Street, Cambridge, MA 02139, USA

  • Venue:
  • International Journal of Human-Computer Studies
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Predicting when a person might be frustrated can provide an intelligent system with important information about when to initiate interaction. For example, an automated Learning Companion or Intelligent Tutoring System might use this information to intervene, providing support to the learner who is likely to otherwise quit, while leaving engaged learners free to discover things without interruption. This paper presents the first automated method that assesses, using multiple channels of affect-related information, whether a learner is about to click on a button saying ''I'm frustrated.'' The new method was tested on data gathered from 24 participants using an automated Learning Companion. Their indication of frustration was automatically predicted from the collected data with 79% accuracy (chance=58%). The new assessment method is based on Gaussian process classification and Bayesian inference. Its performance suggests that non-verbal channels carrying affective cues can help provide important information to a system for formulating a more intelligent response.