iMime: an interactive character animation system for use in dementia care

Authors:
Andreas Wiratanaya;Michael J. Lyons;Nicholas J. Butko;Shinji Abe
Affiliations:
IRC Labs, Souraku-gun, Kyoto;IRC Labs, Souraku-gun, Kyoto;University of California at San Diego;IRC Labs, Souraku-gun, Kyoto
Venue:
Proceedings of the 12th international conference on Intelligent user interfaces
Year:
2007

Citing 5
Cited 0

Pfinder: Real-Time Tracking of the Human Body

IEEE Transactions on Pattern Analysis and Machine Intelligence
Reinforcement Learning

Reinforcement Learning
Visual Interaction With Lifelike Characters

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Sonification of facial actions for musical expression

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Ambient Display using Musical Effects

Proceedings of the 11th international conference on Intelligent user interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe the design and implementation of an interactive character animation interface. The system analyzes the attentive state and aspects of the affective behaviour of a viewer using input from a video camera and uses this to control the behaviour of a cartoon-like animated character. Using the interaction metaphor of a mime artist, we design the system to encourage viewer attention and interaction, with adaptation using an online reinforcement learning based on the viewer's attentive state. This work is ultimately aimed at developing a system to support the care of dementia sufferers.