Neural networks: a systematic introduction
Neural networks: a systematic introduction
Integration and synchronization of input modes during multimodal human-computer interaction
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Embodied conversational interface agents
Communications of the ACM
BEAT: the Behavior Expression Animation Toolkit
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
MPEG-4 Facial Animation: The Standard,Implementation and Applications
MPEG-4 Facial Animation: The Standard,Implementation and Applications
Formational Parameters and Adaptive Prototype Instantiation for MPEG-4 Compliant Gesture Synthesis
CA '02 Proceedings of the Computer Animation
Unification-based multimodal integration
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Finite-state multimodal parsing and understanding
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Synthesizing multimodal utterances for conversational agents: Research Articles
Computer Animation and Virtual Worlds
Automated methods for data-driven synthesis of realistic and controllable human motion
Automated methods for data-driven synthesis of realistic and controllable human motion
Beyond virtual tutors: semi-autonomous characters as learning companions
SIGGRAPH '05 ACM SIGGRAPH 2005 Educators program
Proceedings of the 2007 symposium on Interactive 3D graphics and games
Gesture modeling and animation based on a probabilistic re-creation of speaker style
ACM Transactions on Graphics (TOG)
Fully generated scripted dialogue for embodied agents
Artificial Intelligence
SmartBody: behavior realization for embodied conversational agents
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
The Behavior Markup Language: Recent Developments and Challenges
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Recognizing Affective Dimensions from Body Posture
ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Towards Natural Head Movement of Autonomous Speaker Agent
KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part II
IDEAS4Games: Building Expressive Virtual Characters for Computer Games
IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Towards Facial Gestures Generation by Speech Signal Analysis Using HUGE Architecture
Multimodal Signals: Cognitive and Algorithmic Issues
Studies on gesture expressivity for a virtual agent
Speech Communication
EMBR --- A Realtime Animation Engine for Interactive Embodied Agents
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Implementing a Multi-user Tour Guide System with an Embodied Conversational Agent
AMT '09 Proceedings of the 5th International Conference on Active Media Technology
Enhancing human-computer interaction with embodied conversational agents
UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
Towards a common framework for multimodal generation: the behavior markup language
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Nonverbal behavior generator for embodied conversational agents
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
[HUGE]: universal architecture for statistically based HUman GEsturing
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Human perception of jitter and media synchronization
IEEE Journal on Selected Areas in Communications
Demonstrating and testing the BML compliance of BML realizers
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
An incremental multimodal realizer for behavior co-articulation and coordination
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
| Hi-index | 0.00 |
Applications with intelligent conversational virtual humans, called Embodied Conversational Agents (ECAs), seek to bring human-like abilities into machines and establish natural human-computer interaction. In this paper we discuss realization of ECA multimodal behaviors which include speech and nonverbal behaviors. We devise RealActor, an open-source, multi-platform animation system for real-time multimodal behavior realization for ECAs. The system employs a novel solution for synchronizing gestures and speech using neural networks. It also employs an adaptive face animation model based on Facial Action Coding System (FACS) to synthesize face expressions. Our aim is to provide a generic animation system which can help researchers create believable and expressive ECAs.