The Virtual Human Interface: A Photorealistic Digital Human

  • Authors:
  • Barnabás Takács;Bernadette Kiss

  • Affiliations:
  • -;-

  • Venue:
  • IEEE Computer Graphics and Applications
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article presents a multimodal human-computer interface that employs photorealistic virtual humans that can talk, emote, and act adaptively and intelligently in response to the actions of a user in front of a computer screen. The authors implemented this virtual human interface (VHI) system in a high-performance real-time, visual environment. This article describes novel 3D facial modeling and animation techniques used to design virtual faces capable of delivering fine details of metacommunication and supporting verbal content. It also introduces an artificial expression space representation to control the emotions and expressions of the animated digital human characters. The article describes the use of intelligent sensory mechanisms-such as vision, hearing, and touching-and presents special purpose sensory modules-such as face recognition and expression analysis. Experimental results of the VHI environment and practical application areas, including the first holographic virtual human, are discussed.