Depth silhouettes for gesture recognition

Authors:
Rafael Muñoz-Salinas;R. Medina-Carnicer;F. J. Madrid-Cuevas;A. Carmona-Poyato
Affiliations:
Department of Computing and Numerical Analysis, University of Córdoba, 14071 Córdoba, Spain;Department of Computing and Numerical Analysis, University of Córdoba, 14071 Córdoba, Spain;Department of Computing and Numerical Analysis, University of Córdoba, 14071 Córdoba, Spain;Department of Computing and Numerical Analysis, University of Córdoba, 14071 Córdoba, Spain
Venue:
Pattern Recognition Letters
Year:
2008

Citing 21
Cited 10

Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
The nature of statistical learning theory

The nature of statistical learning theory
Recognition of hand gestures with 3D, nonlinear arm movement

Pattern Recognition Letters
The Recognition of Human Movement Using Temporal Templates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Real-Time Tracking of Articulated Human Models Using a 3D Shape-from-Silhouette Method

RobVis '01 Proceedings of the International Workshop on Robot Vision
Advances in Computational Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognition-based gesture spotting in video games

Pattern Recognition Letters
Recovering 3D Human Pose from Monocular Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hand gesture modelling and recognition involving changing shapes and trajectories, using a Predictive EigenTracker

Pattern Recognition Letters
Silhouette lookup for monocular 3D pose tracking

Image and Vision Computing
Simultaneous pose recovery and camera registration from multiple views of a walking person

Image and Vision Computing
Free viewpoint action recognition using motion history volumes

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Outdoor recognition at a distance by fusing gait and face

Image and Vision Computing
People detection and tracking using stereo vision and color

Image and Vision Computing
Human gait recognition by the fusion of motion and static spatio-temporal templates

Pattern Recognition
Reconstruction of 3D human body pose from stereo image sequences based on top-down learning

Pattern Recognition
Visual recognition of pointing gestures for human-robot interaction

Image and Vision Computing
Three dimensional gesture recognition using modified matching algorithm

ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part II
Nonlinear body pose estimation from depth images

PR'05 Proceedings of the 27th DAGM conference on Pattern Recognition
Effect of silhouette quality on hard problems in gait recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Identification of humans using gait

IEEE Transactions on Image Processing

Recognition of gestures in Pakistani sign language using fuzzy classifier

ISCGAV'08 Proceedings of the 8th conference on Signal processing, computational geometry and artificial vision
Multi-camera people tracking using evidential filters

International Journal of Approximate Reasoning
People detection and tracking with multiple stereo cameras using particle filters

Journal of Visual Communication and Image Representation
Shape from silhouette using Dempster-Shafer theory

Pattern Recognition
A statistical feature based decision tree approach for hand gesture recognition

Proceedings of the 7th International Conference on Frontiers of Information Technology
Daily human activity recognition using depth silhouettes and R transformation for smart home

ICOST'11 Proceedings of the 9th international conference on Toward useful services for elderly and people with disabilities: smart homes and health telematics
A spanning tree-based human activity prediction system using life logs from depth silhouette-based human activity recognition

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part I
Shape from pairwise silhouettes for plan-view map generation

Image and Vision Computing
Multi-modal user interaction method based on gaze tracking and gesture recognition

Image Communication
Automatic scene calibration for detecting and tracking people using a single camera

Engineering Applications of Artificial Intelligence

Quantified Score

Hi-index	0.10

Visualization

Abstract

This paper, evaluates the influence of depth information on the gesture recognition process. We propose depth silhouettes, a natural extension of the binary silhouette concept, as a mechanism to incorporate depth information for gesture recognition. Using depth silhouettes, we define extensions of three classic techniques employed previously for gesture recognition with monocular vision. These include: (a) silhouette compression using PCA and learning with HMM; (b) an exemplar-based gesture recognition using HMM; and (c) temporal templates that in this work are compressed using PCA and learned with SVM. The results obtained show that, independently of the technique employed, the use of depth silhouettes increases the success significantly. Additionally, we show how the best results are obtained through the combined use of PCA and HMM.