IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Recognition based on a 3D Morphable Model
FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Real Time Feature Based 3-D Deformable Face Tracking
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II
Sequential Belief-Based Fusion of Manual and Non-manual Information for Recognizing Isolated Signs
Gesture-Based Human-Computer Interaction and Simulation
Czech text-to-sign speech synthesizer
MLMI'07 Proceedings of the 4th international conference on Machine learning for multimodal interaction
Real-Time Bayesian 3-D Pose Tracking
IEEE Transactions on Circuits and Systems for Video Technology
Correct speech visemes as a root of total communication method for deaf people
KES-AMSTA'12 Proceedings of the 6th KES international conference on Agent and Multi-Agent Systems: technologies and applications
| Hi-index | 0.00 |
This paper deals with novel automatic categorization of signs used in sign language dictionaries. The categorization provides additional information about lexical signs interpreted in the form of video files. We design a new method for automatic parameterization of these video files and categorization of the signs from extracted information. The method incorporates advanced image processing for detection and tracking of hands and head of signing character in the input image sequences. For tracking of hands we developed an algorithm based on object detection and discriminative probability models. For the tracking of head we use active appearance model. This method is a very powerful for detection and tracking of human face. We specify feasible conditions of the model enabling to use the extracted parameters for basic categorization of the non-manual component. We introduce an experiment with the automatic categorization determining symmetry, location and contact of hands, shape of mouth, close eyes and others. The result of experiment is primary the categorization of more than 200 signs and discussion of problems and next extension.