A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis

Authors:
Charly Awad;Nicolas Courty;Kyle Duarte;Thibaut Naour;Sylvie Gibet
Affiliations:
Laboratoire VALORIA, Bâtiment Yves Coppens, Université de Bretagne Sud, Vannes, France F-56017;Laboratoire VALORIA, Bâtiment Yves Coppens, Université de Bretagne Sud, Vannes, France F-56017;Laboratoire VALORIA, Bâtiment Yves Coppens, Université de Bretagne Sud, Vannes, France F-56017;Laboratoire VALORIA, Bâtiment Yves Coppens, Université de Bretagne Sud, Vannes, France F-56017;Laboratoire VALORIA, Bâtiment Yves Coppens, Université de Bretagne Sud, Vannes, France F-56017 and IRISA, Rennes, France F-35042
Venue:
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Year:
2009

Citing 7
Cited 4

Real-time inverse kinematics techniques for anthropomorphic limbs

Graphical Models and Image Processing
Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders

Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Motion synthesis from annotations

ACM SIGGRAPH 2003 Papers
Synthesizing multimodal utterances for conversational agents: Research Articles

Computer Animation and Virtual Worlds
Gesture modeling and animation based on a probabilistic re-creation of speaker style

ACM Transactions on Graphics (TOG)
Towards Natural Gesture Synthesis: Evaluating Gesture Units in a Data-Driven Approach to Gesture Synthesis

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
The Behavior Markup Language: Recent Developments and Challenges

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents

Why is the creation of a virtual signer challenging computer animation?

MIG'10 Proceedings of the Third international conference on Motion in games
The SignCom system for data-driven animation of interactive virtual signers: Methodology and Evaluation

ACM Transactions on Interactive Intelligent Systems (TiiS)
Data-Driven Synthesis of Spatially Inflected Verbs for American Sign Language Animation

ACM Transactions on Accessible Computing (TACCESS)
Toward a motor theory of sign language perception

GW'11 Proceedings of the 9th international conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

Over the past decade, motion capture data has become a popular research tool, and motion databases have grown exponentially. Indexing, querying, and retrieving data has thus become more difficult, and has necessitated innovative approaches to using these databases. Our aim is to make this approach feasible for virtual agents signing in French Sign Language (LSF), taking into account the semantic information implicitly contained in language data. We thus structure a database in two autonomous units, taking advantage of differing indexing methods within each. This allows us to effectively retrieve captured motions to produce LSF animations. We describe our methods for querying motion in the semantic database, computing transitory segments between concatenated signs, and producing realistic animations of a virtual LSF signer.