An emotion aware agent platform for interactive storytelling and gaming

  • Authors:
  • Zhiqi Shen;Chunyan Miao;Liang Zhang;Han Yu;Mark J. Chavez

  • Affiliations:
  • Nanyang Technological University, Singapore;Nanyang Technological University, Singapore;Nanyang Technological University, Singapore;Nanyang Technological University, Singapore;Nanyang Technological University, Singapore

  • Venue:
  • Futureplay '10 Proceedings of the International Academic Conference on the Future of Game Design and Technology
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

As an emerging medium and industry, computer games received a lot of attention from scholars across a variety of disciplines. The realistic 3D graphics, intelligent non-player characters (NPC) and fascinating game play have made a great impact on user experience in the entertainment domain, e-Learning and other gaming related applications. In this paper, we investigate the game from another perspective - how the game can be affected by the player's real-time experience, such as emotion and gesture. A generic goal oriented software agent platform is proposed to automatically refine the animation, the NPC's personality and emotions, and the game story by learning from the player's realtime feedback from the emotion analyzing and gesture tracking modules. Fuzzy cognitive maps (FCMs) and data mining techniques are used to infer the mutual influences between the player's real world experience and the contents of the game. The adaptation of game to the player's real-time reactions will bring dynamism into the player's game experience. The proposed agent platform has been integrated with several commercial game engines including Unreal Engine 3, and Torque, etc.