Animation control for real-time virtual humans
Communications of the ACM
BEAT: the Behavior Expression Animation Toolkit
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Toward a New Generation of Virtual Humans for Interactive Experiences
IEEE Intelligent Systems
The Virtual Human Interface: A Photorealistic Digital Human
IEEE Computer Graphics and Applications
Special Education and Rehabilitation: Teaching and Healing with Interactive Graphics
IEEE Computer Graphics and Applications
Eye communication in a conversational 3D synthetic agent
AI Communications
| Hi-index | 0.00 |
This paper describes an advanced human-computer interface that combines real-time, reactive and high fidelity virtual humans with artificial vision and communicative intelligence to create a closed-loop interaction model and achieve an affective interface. The system, called the Virtual Human Interface (VHI), utilizes a photo-real facial and body model as a virtual agent to convey information beyond speech and actions. Specifically, the VHI uses a dictionary of nonverbal signals including body language, hand gestures and subtle emotional display to support verbal content in a reactive manner. Furthermore, its built in facial tracking and artificial vision system allows the virtual human to maintain eye contact, follow the motion of the user and even recognizing when somebody joins him or her in front of the terminal and act accordingly. Additional sensors allow the virtual agent to react to touch, voice and other modalities of interaction. The system has been tested in a real-world scenario whereas a virtual child reacted to visitors in an exhibition space.