Modeling confusion: facial expression, task, and discourse in task-oriented tutorial dialogue

  • Authors:
  • Joseph F. Grafsgaard;Kristy Elizabeth Boyer;Robert Phillips;James C. Lester

  • Affiliations:
  • Department of Computer Science, North Carolina State University, Raleigh, North Carolina;Department of Computer Science, North Carolina State University, Raleigh, North Carolina;Department of Computer Science, North Carolina State University, Raleigh, North Carolina and Applied Research Associates, Inc., Raleigh, North Carolina;Department of Computer Science, North Carolina State University, Raleigh, North Carolina

  • Venue:
  • AIED'11 Proceedings of the 15th international conference on Artificial intelligence in education
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recent years have seen a growing recognition of the importance of affect in learning. Efforts are being undertaken to enable intelligent tutoring systems to recognize and respond to learner emotion, but the field has not yet seen the emergence of a fully contextualized model of learner affect. This paper reports on a study of learner affect through an analysis of facial expression in human task-oriented tutorial dialogue. It extends prior work through in-depth analyses of a highly informative facial action unit and its interdependencies with dialogue utterances and task structure. The results demonstrate some ways in which learner facial expressions are dependent on both dialogue and task context. The findings also hold design implications for affect recognition and tutorial strategy selection within tutorial dialogue systems.