Real time gesture recognition using continuous time recurrent neural networks

Authors:
Gonzalo Bailador;Daniel Roggen;Gerhard Tröster;Gracián Triviño
Affiliations:
Univ. Politécnica de Madrid, Madrid, Spain;Wearable Computing Lab, ETH Zürich, Zürich, Switzerland;Wearable Computing Lab, ETH Zürich, Zürich, Switzerland;European Centre for Soft Computing, Edificio Científico Tecnológico, Asturias, Spain
Venue:
Proceedings of the ICST 2nd international conference on Body area networks
Year:
2007

Citing 14
Cited 6

Gesture recognition using recurrent neural networks

CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Original Contribution: Approximation of dynamical systems by continuous time recurrent neural networks

Neural Networks
Sequential behavior and learning in evolved dynamical neural networks

Adaptive Behavior
On the dynamics of small continuous-time recurrent neural networks

Adaptive Behavior - Special issue on computational neuroethology
Inertial proprioceptive devices: self-motion-sensing toys and tools

IBM Systems Journal
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
WearNET: A Distributed Multi-sensor System for Context Aware Wearables

UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Towards Model-Based Gesture Recognition

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Tinmith-Metro: New Outdoor Techniques for Creating City Models with an Augmented Reality Wearable Computer

ISWC '01 Proceedings of the 5th IEEE International Symposium on Wearable Computers
Using Gravity to Estimate Accelerometer Orientation

ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Recognition-based gesture spotting in video games

Pattern Recognition Letters
Toward wearable social networking with iBand

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Evolving reinforcement learning-like abilities for robots

ICES'03 Proceedings of the 5th international conference on Evolvable systems: from biology to hardware
A recurrent fuzzy network for fuzzy temporal sequence processing and gesture recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Pattern recognition using temporal fuzzy automata

Fuzzy Sets and Systems
Hand movement recognition for brazilian sign language: a study using distance-based neural networks

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
An application oriented and shape feature based multi-touch gesture description and recognition method

Multimedia Tools and Applications
Reconfigurable natural interaction in smart environments: approach and prototype implementation

Personal and Ubiquitous Computing
The impact of motion dimensionality and bit cardinality on the design of 3D gesture recognizers

International Journal of Human-Computer Studies
Gesture recognition using neural networks based on HW/SW cosimulation platform

Advances in Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a new approach to the problem of gesture recognition in real time using inexpensive accelerometers. This approach is based on the idea of creating specialized signal predictors for each gesture class. These signal predictors forecast future acceleration values from current ones. The errors between the measured acceleration of a given gesture and the predictors are used for classification. This approach is modular and allows for seamless inclusion of new gesture classes. These predictors are implemented using Continuous Time Recurrent Neural Networks (CTRNN). On the one hand, this kind of networks exhibits rich dynamical behaviour that is useful in gesture recognition and on the other, they have a relatively low computational cost that is interesting feature for real time systems.