Vision-Based recognition of fingerspelled acronyms using hierarchical temporal memory

Authors:
Tomasz Kapuscinski
Affiliations:
Department of Computer and Control Engineering, Rzeszow University of Technology, Rzeszow, Poland
Venue:
ICAISC'12 Proceedings of the 11th international conference on Artificial Intelligence and Soft Computing - Volume Part I
Year:
2012

Citing 5
Cited 0

Appearance based recognition methodology for recognising fingerspelling alphabets

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Using hierarchical temporal memory for vision-based hand shape recognition under large variations in hand's rotation

ICAISC'10 Proceedings of the 10th international conference on Artifical intelligence and soft computing: Part II
Recognition of finger spelling of American sign language with artificial neural network using position/orientation sensors and data glove

ISNN'05 Proceedings of the Second international conference on Advances in neural networks - Volume Part II
Fingerspelling recognition through classification of letter-to-letter transitions

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Turkish fingerspelling recognition system using axis of least inertia based fast alignment

AI'06 Proceedings of the 19th Australian joint conference on Artificial Intelligence: advances in Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, a new, glove-free method for recognition of fingerspelled acronyms using hierarchical temporal memory has been proposed. The task is challenging because many signs look similar from the camera viewpoint. Moreover handshapes are distorted strongly as a result of coarticulation and motion blur, especially in the fluent fingerspelling. In the described work, the problem has been tackled by applying the new, bio-inspired recognition engine, based on structural and functional properties of mammalian neocortex, robust to local changes shape descriptors, and a training scheme allowing for capture possible handshape deformations in a manner that is lexicon independent.