Representing coordination and non-coordination in an american sign language animation

Authors:
Matt Huenerfauth
Affiliations:
University of Pennsylvania, Philadelphia, PA
Venue:
Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Year:
2005

Citing 7
Cited 3

Multidimensional trees

Theoretical Computer Science
Parsing Nonlinear Languages

IEEE Transactions on Software Engineering
A formal framework for linguistic annotation

Speech Communication - Special issue on speech annotation and corpus tools
BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Towards integrated microplanning of language and iconic gesture for multimodal output

Proceedings of the 6th international conference on Multimodal interfaces
Coordination and context-dependence in the generation of embodied conversation

INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
American sign language generation: multimodal NLG with multiple linguistic channels

ACLstudent '05 Proceedings of the ACL Student Research Workshop

Intelligent Thai text - Thai sign translation for language learning

Computers & Education
Using mobile devices to support communication between emergency medical responders and deaf people

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Requirements for a gesture specification language: a comparison of two representation formalisms

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

While strings and syntax trees are used by the Natural Language Processing community to represent the structure of spoken languages, these encodings are difficult to adapt to a signed language like American Sign Language (ASL). In particular, the multichannel nature of an ASL performance makes it difficult to encode in a linear single-channel string. This paper will introduce the Partition/Constitute (P/C) Formalism, a new method of computationally representing a linguistic signal containing multiple channels. The formalism allows coordination and non-coordination relationships to be encoded between different portions of a signal. The P/C formalism will be compared to representations used in related research in gesture animation. The way in which P/C is used by this project to build an English-to-ASL machine translation system will also be discussed.