Toward a motor theory of sign language perception

Authors:
Sylvie Gibet;Pierre-François Marteau;Kyle Duarte
Affiliations:
IRISA, Université de Bretagne Sud, Vannes Cedex, France;IRISA, Université de Bretagne Sud, Vannes Cedex, France;IRISA, Université de Bretagne Sud, Vannes Cedex, France
Venue:
GW'11 Proceedings of the 9th international conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication
Year:
2011

Citing 8
Cited 0

A Complete System for the Specification and the Generation of Sign Language Gestures

GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Expressive Gesture Animation Based on Non Parametric Learning of Sensory-Motor Models

CASA '03 Proceedings of the 16th International Conference on Computer Animation and Social Agents (CASA 2003)
Analysis of Human Motion, Based on the Reduction of Multidimensional Captured Data --- Application to Hand Gesture Compression, Segmentation and Synthesis

AMDO '08 Proceedings of the 5th international conference on Articulated Motion and Deformable Objects
A Qualitative and Quantitative Characterisation of Style in Sign Language Gestures

Gesture-Based Human-Computer Interaction and Simulation
A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Why is the creation of a virtual signer challenging computer animation?

MIG'10 Proceedings of the Third international conference on Motion in games
The SignCom system for data-driven animation of interactive virtual signers: Methodology and Evaluation

ACM Transactions on Interactive Intelligent Systems (TiiS)
Captured motion data processing for real time synthesis of sign language

GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Researches on signed languages still strongly dissociate linguistic issues related on phonological and phonetic aspects, and gesture studies for recognition and synthesis purposes. This paper focuses on the imbrication of motion and meaning for the analysis, synthesis and evaluation of sign language gestures. We discuss the relevance and interest of a motor theory of perception in sign language communication. According to this theory, we consider that linguistic knowledge is mapped on sensory-motor processes, and propose a methodology based on the principle of a synthesis-by-analysis approach, guided by an evaluation process that aims to validate some hypothesis and concepts of this theory. Examples from existing studies illustrate the different concepts and provide avenues for future work.