Generation of facial expression for communication using elfoid with projector

Authors:
Maiya Hori;Hideki Takakura;Hiroki Yoshimura;Yoshio Iwai
Affiliations:
Graduate School of Engineering, Tottori University, Tottori, Japan;Graduate School of Engineering, Tottori University, Tottori, Japan;Graduate School of Engineering, Tottori University, Tottori, Japan;Graduate School of Engineering, Tottori University, Tottori, Japan
Venue:
MPRSS'12 Proceedings of the First international conference on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction
Year:
2012

Citing 4
Cited 0

Active shape models—their training and application

Computer Vision and Image Understanding
Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Active Appearance Models Revisited

International Journal of Computer Vision
Realtime performance-based facial animation

ACM SIGGRAPH 2011 papers

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a method for generating facial expressions with a mobile projector built into a cellphone-type tele-operated android, called Elfoid. Elfoid is designed to transmit the presence of a speaker to a communication partner in a remote place using a camera and microphone and a soft exterior that provides the look and feel of human skin. To transmit the presence of a speaker, Elfoid sends not only voice but also facial expressions and emotion information captured by the camera and microphone. Elfoid cannot, however, display facial motions because of its compactness and the lack of sufficiently small actuator motors. Therefore, we use a mobile projector and generate projection patterns to represent facial expressions estimated with a camera.