An autonomous and user-independent hand posture recognition system for vision-based interface tasks

Authors:
Elena Sánchez-Nielsen;Luis Antón-Canalís;Cayetano Guerra-Artal
Affiliations:
Dpto. E.I.O. y Computación, Universidad de La Laguna, Spain;Instituto de Sistemas Inteligentes (IUSIANI), Las Palmas de G.C., Spain;Instituto de Sistemas Inteligentes (IUSIANI), Las Palmas de G.C., Spain
Venue:
CAEPIA'05 Proceedings of the 11th Spanish association conference on Current Topics in Artificial Intelligence
Year:
2005

Citing 10
Cited 0

Distance transforms: properties and machine vision applications

CVGIP: Graphical Models and Image Processing
Pfinder: Real-Time Tracking of the Human Body

IEEE Transactions on Pattern Analysis and Machine Intelligence
Representation and recognition in vision

Representation and recognition in vision
The visual analysis of human movement: a survey

Computer Vision and Image Understanding
Perceptual user interfaces: perceptual intelligence

Communications of the ACM
A System for Person-Independent Hand Posture Recognition against Complex Backgrounds

IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Visual Recognition Using the Hausdorff Distance

Efficient Visual Recognition Using the Hausdorff Distance
Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Computer vision in the interface

Communications of the ACM - Multimodal interfaces that flex, adapt, and persist
A new approach to the template update problem

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a system for hand posture recognition that works with colour video streams under varying light conditions for human-machine interaction in vision-based interface tasks. No initialization of the system is required and no user dependence is involved. With this aim, we first model on-line each user's skin colour from the skin cue imaging of his/her face detected by means of Viola and Jones detector. Afterwards, a second order isomorphism approach performs tracking on skin colour blob based detected hand. Also, we propose this approach as a mechanism to estimate hand transition states. Finally, evidences about hand postures are recognized by shape matching, which is carried out through a holistic similarity measure focused on the Hausdorff distance. The paper includes experimental evaluations of the recognition system for 16 different hand postures in different video streams. The results show that the system can be suitable for real-time interfaces using general purpose hardware.