Persian sign language (PSL) recognition using wavelet transform and neural networks

Authors:
Ali Karami;Bahman Zanj;Azadeh Kiani Sarkaleh
Affiliations:
Faculty of Engineering, University of Guilan, P.O. Box 41635-3756, Rasht, Iran;Faculty of Engineering, University of Guilan, P.O. Box 41635-3756, Rasht, Iran;Faculty of Engineering, University of Guilan, P.O. Box 41635-3756, Rasht, Iran
Venue:
Expert Systems with Applications: An International Journal
Year:
2011

Citing 10
Cited 6

A Theory for Multiresolution Signal Decomposition: The Wavelet Representation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Specifying gestures by example

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Signal Analysis: Wavelets, Filter Banks, Time-Frequency Transforms and Applications

Signal Analysis: Wavelets, Filter Banks, Time-Frequency Transforms and Applications
A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language

PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
A Real-Time Continuous Gesture Recognition System for Sign Language

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
CSLDS: Chinese Sign Language Dialog System

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Taiwan sign language (TSL) recognition based on 3D data and neural networks

Expert Systems with Applications: An International Journal
Gesture Recognition: A Survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews

Extending the bioinspired hierarchical temporal memory paradigm for sign language recognition

Neurocomputing
Control of a service robot using the mexican sign language

MICAI'11 Proceedings of the 10th international conference on Artificial Intelligence: advances in Soft Computing - Volume Part II
LSESpeak: A spoken language generator for Deaf people

Expert Systems with Applications: An International Journal
Increasing adaptability of a speech into sign language translation system

Expert Systems with Applications: An International Journal
Classification of MRI brain images using combined wavelet entropy based spider web plots and probabilistic neural network

Pattern Recognition Letters
Methodology for developing an advanced communications system for the Deaf in a new domain

Knowledge-Based Systems

Quantified Score

Hi-index	12.05

Visualization

Abstract

This paper presents a system for recognizing static gestures of alphabets in Persian sign language (PSL) using Wavelet transform and neural networks (NN). The required images for the selected alphabets are obtained using a digital camera. The color images are cropped, resized, and converted to grayscale images. Then, the discrete wavelet transform (DWT) is applied on the gray scale images, and some features are extracted. Finally, the extracted features are used to train a Multi-Layered Perceptron (MLP) NN. Our recognition system does not use any gloves or visual marking systems. This system only requires the images of the bare hand for the recognition. The system is implemented and tested using a data set of 640 samples of Persian sign images; 20 images for each sign. Experimental results show that our system is able to recognize 32 selected PSL alphabets with an average classification accuracy of 94.06%.