Recognition of gestures in Arabic sign language using neuro-fuzzy systems

Authors:
Omar Al-Jarrah;Alaa Halawani
Affiliations:
Jordan Univ. of Science and Technology, Irbid, Jordan;Jordan Univ. of Science and Technology, Irbid, Jordan
Venue:
Artificial Intelligence
Year:
2001

Citing 8
Cited 23

Fundamentals of digital image processing

Fundamentals of digital image processing
The Design and Use of Steerable Filters

IEEE Transactions on Pattern Analysis and Machine Intelligence
Machine vision

Machine vision
Face Recognition by Elastic Bunch Graph Matching

IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer Vision for Interactive Computer Graphics

IEEE Computer Graphics and Applications
Computer vision for computer games

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Robust classification of hand postures against complex backgrounds

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)

Purdue RVL-SLLL ASL Database for Automatic Recognition of American Sign Language

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Editorial: fuzzy set and possibility theory-based methods in artificial intelligence

Artificial Intelligence - Special issue: Fuzzy set and possibility theory-based methods in artificial intelligence
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hand gesture modelling and recognition involving changing shapes and trajectories, using a Predictive EigenTracker

Pattern Recognition Letters
Recognition of Arabic sign language alphabet using polynomial classifiers

EURASIP Journal on Applied Signal Processing
Viewpoint invariant sign language recognition

Computer Vision and Image Understanding
Image and video for hearing impaired people

Journal on Image and Video Processing
IMPROVING GESTURE RECOGNITION IN THE ARABIC SIGN LANGUAGE USING TEXTURE ANALYSIS

Applied Artificial Intelligence
Taiwan sign language (TSL) recognition based on 3D data and neural networks

Expert Systems with Applications: An International Journal
A committee machine with intelligent systems for estimation of total organic carbon content from petrophysical data: An example from Kangan and Dalan reservoirs in South Pars Gas Field, Iran

Computers & Geosciences
Video-based signer-independent Arabic sign language recognition using hidden Markov models

Applied Soft Computing
Petrophysical data prediction from seismic attributes using committee fuzzy inference system

Computers & Geosciences
On the use of graph parsing for recognition of isolated hand postures of Polish Sign Language

Pattern Recognition
Automatic recognition of finger spelling for LIBRAS based on a two-layer architecture

Proceedings of the 2010 ACM Symposium on Applied Computing
A person independent system for recognition of hand postures used in sign language

Pattern Recognition Letters
Recognition of dynamic gestures in arabic sign language using two stages hierarchical scheme

International Journal of Knowledge-based and Intelligent Engineering Systems
The parameters effect on performance in ANN for hand gesture recognition system

Expert Systems with Applications: An International Journal
Multimodal continuous recognition system for greek sign language using various grammars

SETN'06 Proceedings of the 4th Helenic conference on Advances in Artificial Intelligence
A signer-independent Arabic Sign Language recognition system using face detection, geometric features, and a Hidden Markov Model

Computers and Electrical Engineering
Control of a service robot using the mexican sign language

MICAI'11 Proceedings of the 10th international conference on Artificial Intelligence: advances in Soft Computing - Volume Part II
Improving the accuracy of flow units prediction through two committee machine models: An example from the South Pars Gas Field, Persian Gulf Basin, Iran

Computers & Geosciences
A proposed PCNN features quality optimization technique for pose-invariant 3D Arabic sign language recognition

Applied Soft Computing
Finding recurrent patterns from continuous sign language sentences for automated extraction of signs

The Journal of Machine Learning Research

Quantified Score

Hi-index	0.01

Visualization

Abstract

Hand gestures play an important role in communication between people during their daily lives. But the extensive use of hand gestures as a mean of communication can be found in sign languages. Sign language is the basic communication method between deaf people. A translator is usually needed when an ordinary person wants to communicate with a deaf one. The work presented in this paper aims at developing a system for automatic translation of gestures of the manual alphabets in the Arabic sign language. In doing so, we have designed a collection of ANFIS networks, each of which is trained to recognize one gesture. Our system does not rely on using any gloves or visual markings to accomplish the recognition job. Instead, it deals with images of bare hands, which allows the user to interact with the system in a natural way. An image of the hand gesture is processed and converted into a set of features that comprises of the lengths of some vectors which are selected to span the fingertips' region. The extracted features are rotation, scale, and translation invariat, which makes the system more flexible. The subtractive clustering algorithm and the least-squares estimator are used to identify the fuzzy inference system, and the training is achieved using the hybrid learning algorithm. Experiments revealed that our system was able to recognize the 30 Arabic manual alphabets with an accuracy of 93.55%.