Parameterized facial expression synthesis based on MPEG-4

Authors:
Amaryllis Raouzaiou;Nicolas Tsapatsoulis;Kostas Karpouzis;Stefanos Kollias
Affiliations:
Department of Electrical and Computer Engineering, National Technical University of Athens, Heroon Polytechniou, Zographou, Greece;Department of Electrical and Computer Engineering, National Technical University of Athens, Heroon Polytechniou, Zographou, Greece;Department of Electrical and Computer Engineering, National Technical University of Athens, Heroon Polytechniou, Zographou, Greece;Department of Electrical and Computer Engineering, National Technical University of Athens, Heroon Polytechniou, Zographou, Greece
Venue:
EURASIP Journal on Applied Signal Processing
Year:
2002

Citing 7
Cited 24

Fuzzy sets and fuzzy logic: theory and applications

Fuzzy sets and fuzzy logic: theory and applications
Computer facial animation

Computer facial animation
Coding, Analysis, Interpretation, and Recognition of Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Neural Network-Based Face Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View

IEEE Transactions on Pattern Analysis and Machine Intelligence
The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces

IEEE Transactions on Circuits and Systems for Video Technology
MPEG-4 facial animation technology: survey, implementation, and results

IEEE Transactions on Circuits and Systems for Video Technology

2005 Special Issue: Emotion recognition through facial expression analysis based on a neurofuzzy network

Neural Networks - Special issue: Emotion and brain
Emotion representation for online gaming

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Modeling naturalistic affective states via facial and vocal expressions recognition

Proceedings of the 8th international conference on Multimodal interfaces
Robust feature detection for facial expression recognition

Journal on Image and Video Processing
Dealing with feature uncertainty in facial expression recognition

International Journal of Intelligent Systems Technologies and Applications
An interactive facial expression generation system

Multimedia Tools and Applications
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech

Affect and Emotion in Human-Computer Interaction
MPEG-4 facial expression synthesis

Personal and Ubiquitous Computing
Towards modeling embodied conversational agent character profiles using appraisal theory predictions in expression synthesis

Applied Intelligence
Studies on gesture expressivity for a virtual agent

Speech Communication
An Approach for Creating and Blending Synthetic Facial Expressions of Emotion

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Providing expressive eye movement to virtual agents

Proceedings of the 2009 international conference on Multimodal interfaces
Photo-realistic facial expression synthesis

Image and Vision Computing
An intelligent scheme for facial expression recognition

ICANN/ICONIP'03 Proceedings of the 2003 joint international conference on Artificial neural networks and neural information processing
Affective intelligence: the human face of AI

Artificial intelligence
Synthesizing expressions using facial feature point tracking: how emotion is conveyed

Proceedings of the 3rd international workshop on Affective interaction in natural environments
Developing educational and entertaining virtual humans using Elckerlyc

ICEC'10 Proceedings of the 9th international conference on Entertainment computing
Modeling naturalistic affective states via facial, vocal, and bodily expressions recognition

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Adaptive on-line neural network retraining for real life multimodal emotion recognition

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
Emotion analysis in man-machine interaction systems

MLMI'04 Proceedings of the First international conference on Machine Learning for Multimodal Interaction
Multimodal sensing, interpretation and copying of movements by a virtual agent

PIT'06 Proceedings of the 2006 international tutorial and research conference on Perception and Interactive Technologies
An intermediate expressions' generator system in the MPEG-4 framework

VLBV'05 Proceedings of the 9th international conference on Visual Content Processing and Representation
Emotional eye movement generation based on Geneva Emotion Wheel for virtual agents

Journal of Visual Languages and Computing
EEMML: the emotional eye movement animation toolkit

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

In the framework of MPEG-4, one can include applications where virtual agents, utilizing both textual and multisensory data, including facial expressions and nonverbal speech, help systems become accustomed to the actual feelings of the user. Applications of this technology are expected in educational environments, virtual collaborative workplaces, communities, and interactive entertainment. Facial animation has gained much interest within the MPEG-4 framework; with implementation details being an open research area (Tekalp, 1999). In this paper, we describe a method for enriching human computer interaction, focusing on analysis and synthesis of primary and intermediate facial expressions (Ekman and Friesen (1978)). To achieve this goal, we utilize facial animation parameters (FAPs) to model primary expressions and describe a rule-based technique for handling intermediate ones. A relation between FAPs and the activation parameter proposed in classical psychological studies is established, leading to parameterized facial expression analysis and synthesis notions, compatible with the MPEG-4 standard.