Character agents in E-learning interface using multimodal real-time interaction

  • Authors:
  • Hua Wang;Jie Yang;Mark Chignell;Mitsuru Ishizuka

  • Affiliations:
  • University of Toronto;University of Tokyo;University of Toronto;University of Tokyo

  • Venue:
  • HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes an e-learning interface with multiple tutoring character agents. The character agents use eye movement information to facilitate empathy-relevant reasoning and behavior. Eye Information is used to monitor user's attention and interests, to personalize the agent behaviors, and for exchanging information of different learners. The system reacts to multiple users' eye information in real-time and the empathic character agents owned by each learner exchange learner's information to help to form the online learning community. Based on these measures, the interface infers the focus of attention of the learner and responds accordingly with affective and instructional behaviors. The paper will also report on some preliminary usability test results concerning how users respond to the empathic functions and interact with other learners using the character agents.