SOMM: Self organizing Markov map for gesture recognition

Authors:
George Caridakis;Kostas Karpouzis;Athanasios Drosopoulos;Stefanos Kollias
Affiliations:
Image, Video and Multimedia Systems Laboratory, National Technical University of Athens, Athens, Greece;Image, Video and Multimedia Systems Laboratory, National Technical University of Athens, Athens, Greece;Image, Video and Multimedia Systems Laboratory, National Technical University of Athens, Athens, Greece;Image, Video and Multimedia Systems Laboratory, National Technical University of Athens, Athens, Greece
Venue:
Pattern Recognition Letters
Year:
2010

Citing 18
Cited 7

Sign language recognition using model-based tracking and a 3D Hopfield neural network

Machine Vision and Applications
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Parametric Hidden Markov Models for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
User-independent online gesture recognition by relative motion extraction

Pattern Recognition Letters
Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognizing Temporal Trajectories Using the Condensation Algorithm

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Gesture Modeling and Recognition Using Finite State Machines

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognizing Hand-Raising Gestures using HMM

CRV '05 Proceedings of the 2nd Canadian conference on Computer and Robot Vision
Continuous Gesture Recognition using a Sparse Bayesian Classifier

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
Hand gesture modelling and recognition involving changing shapes and trajectories, using a Predictive EigenTracker

Pattern Recognition Letters
Gesture recognition with a Wii controller

Proceedings of the 2nd international conference on Tangible and embedded interaction
Social signal processing: state-of-the-art and future perspectives of an emerging domain

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Probabilistic video-based gesture recognition using self-organizing feature maps

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Real time hand gesture recognition including hand segmentation and tracking

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
A fuzzy rule-based approach to spatio-temporal hand gesturerecognition

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Gesture Recognition: A Survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A recurrent fuzzy network for fuzzy temporal sequence processing and gesture recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Feature representations for the recognition of 3D emblematic gestures

HBU'10 Proceedings of the First international conference on Human behavior understanding
Novel approach to natural child head and hand gestures using roll and slide maximum value algorithm (RSMV)

Proceedings of the 15th WSEAS international conference on Computers
Recognition of manual actions using vector quantization and dynamic time warping

HAIS'10 Proceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part I
Using self-organizing maps for intelligent camera-based user interfaces

HAIS'10 Proceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part II
Non parametric, self organizing, scalable modeling of spatiotemporal inputs: The sign language paradigm

Neural Networks
SAPHE: simple accelerometer based wireless pairing with heuristic trees

Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia
Template based classification of multi-touch gestures

Pattern Recognition

Quantified Score

Hi-index	0.10

Visualization

Abstract

Present work introduces a probabilistic recognition scheme for hand gestures. Self organizing feature maps are used to model spatiotemporal information extracted through image processing. Two models are built for each gesture category and, along with appropriate distance metrics, produce a validated classification mechanism that performs consistently during experiments on acted gestures video sequences. The main focus of current work is to tackle intra and inter user variability during gesture performance by adding flexibility to the decoding procedure and allowing the algorithm to perform an optimal trajectory search while the processing speed of both the feature extraction and the recognition process indicate that the proposed architecture is appropriate for real time and large scale lexicon applications.