The mimic game: real-time recognition and imitation of emotional facial expressions

  • Authors:
  • Nicolas Stoiber;Olivier Aubault;Renaud Seguier;Gaspard Breton

  • Affiliations:
  • Orange Labs/Supelec;Orange Labs;Supelec SCEE;Orange Labs

  • Venue:
  • ACM SIGGRAPH 2010 Talks
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an interactive animated agent system that mimics the facial expressions of a person facing a webcam. Related studies have pursued the same objective from a retargeting perspective, by capturing the facial deformations of a source face to apply them on a virtual character one frame at a time. Our system differs from these approaches in that it works at the semantic level, and not the morphological one. The system first captures the current facial configuration of the user and recognizes his expressive state. The agent then autonomously produces a facial expression based on the identified state, using its own deformation and dynamic characteristics. This behavior is therefore referred to as mimicking instead of retargeting or cloning. Rigid head movements are also captured and mimicked by the agent.