Improving communication skills of children with ASDs through interaction with virtual characters

  • Authors:
  • Bretagne Abirached;Yan Zhang;J. K. Aggarwal;Birgi Tamersoy;Tiago Fernandes;Jose Carlos

  • Affiliations:
  • School of Information, University of Texas at Austin, Austin, USA;School of Information, University of Texas at Austin, Austin, USA;Department of Electrical & Computer Engineering, University of Texas at Austin, Austin, USA;Department of Electrical & Computer Engineering, University of Texas at Austin, Austin, USA;Miranda, Veronica Orvalho, Instituto Telecomuicações, Universidad do Porto, Porto, Portugal;Miranda, Veronica Orvalho, Instituto Telecomuicações, Universidad do Porto, Porto, Portugal

  • Venue:
  • SEGAH '11 Proceedings of the 2011 IEEE 1st International Conference on Serious Games and Applications for Health
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article presents the LIFEisGAME project, a serious game that will help children with ASDs to recognize and express emotions through facial expressions. The game design tackles the main experiential learning cycle of emotion recognition: watch and recognize, learn by doing, recognize and mimic, generalize or knowledge transfer to real life. We briefly describe the technology behind the character animation pipeline centered on the creation of a generic rig. Then, we detail the facial expression analyzer that uses Active Appearance Models. Last, we describe the user study experiment using game mode "recognize the expression".