A Framework for Sign Language Sentence Recognition by Commonsense Context

Authors:
I. Infantino;R. Rizzo;S. Gaglio
Affiliations:
Ist. di Calcolo e Red ad Alte Prestazioni, Palermo;-;-
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Year:
2007

Citing 0
Cited 4

On the use of graph parsing for recognition of isolated hand postures of Polish Sign Language

Pattern Recognition
Non parametric, self organizing, scalable modeling of spatiotemporal inputs: The sign language paradigm

Neural Networks
Convexity local contour sequences for gesture recognition

Proceedings of the 28th Annual ACM Symposium on Applied Computing
Non-manual cues in automatic sign language recognition

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This correspondence proposes a complete framework for sign language recognition that integrates a commonsense engine in order to deal with sentence recognition. The proposed system is based on a multilevel architecture that allows modeling and managing of the knowledge of the recognition process in a simple and robust way. The final abstraction level of this architecture introduces the semantic context and the analysis of the correctness of a sentence given in a sequence of recognized signs. Experimentations are presented using a set of signs from the Italian sign language (LIS) for domotic applications. The implemented system maintains a high recognition rate when the set of signs grows, correcting erroneously recognized single signs using the sentence context.