INTERFACE toolkit: a new tool for building IVAs

Authors:
Piero Cosi;Carlo Drioli;Fabio Tesser;Graziano Tisato
Affiliations:
Istituto di Scienze e Tecnologie della Cognizione, Sezione di Padova "Fonetica e Dialettologia", Consiglio Nazionale delle Ricerche, Padova, Italy;Istituto di Scienze e Tecnologie della Cognizione, Sezione di Padova "Fonetica e Dialettologia", Consiglio Nazionale delle Ricerche, Padova, Italy;Istituto di Scienze e Tecnologie della Cognizione, Sezione di Padova "Fonetica e Dialettologia", Consiglio Nazionale delle Ricerche, Padova, Italy;Istituto di Scienze e Tecnologie della Cognizione, Sezione di Padova "Fonetica e Dialettologia", Consiglio Nazionale delle Ricerche, Padova, Italy
Venue:
Lecture Notes in Computer Science
Year:
2005

Citing 1
Cited 3

Labial Coarticulation Modeling for Realistic Facial Animation

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces

An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behavior

Computers in Entertainment (CIE) - SPECIAL ISSUE: Games
Architecture of a framework for generic assisting conversational agents

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
The effect of emotional colour on creating realistic expression of avatar

Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Quantified Score

Hi-index	0.00

Visualization

Abstract

INTERFACE is an integrated software implemented in Matlab© and created to speed-up the procedure for building an emotive/expressive talking head. Various processing tools, working on dynamic articulatory data physically extracted by an optotracking 3D movement analyzer called ELITE, were implemented to build the animation engine and also to create the correct WAV and FAP files needed for the animation. By the use of INTERFACE, LUCIA, our animated MPEG-4 talking face, can copy a real human by reproducing the movements of passive markers positioned on his face and recorded by an optoelectronic device, or can be directly driven by an emotional XML tagged input text, thus realizing a true audio/visual emotive/expressive synthesis. LUCIA's voice is based on an Italian version of FESTIVAL - MBROLA packages, modified for expressive/emotive synthesis by means of an appropriate APML/VSML tagged language.