Tracking hand and finger movements for behaviour analysis

Authors:
Enrica Dente;Anil Anthony Bharath;Jeffrey Ng;Aldert Vrij;Samantha Mann;Anthony Bull
Affiliations:
Faculty of Engineering, Department of Bioengineering, Imperial College London, Vision Research Group, London, United Kingdom;Faculty of Engineering, Department of Bioengineering, Imperial College London, Vision Research Group, London, United Kingdom;Faculty of Engineering, Department of Bioengineering, Imperial College London, Vision Research Group, London, United Kingdom;University of Portsmouth, United Kingdom;University of Portsmouth, United Kingdom;Faculty of Engineering, Department of Bioengineering, Imperial College London, Vision Research Group, London, United Kingdom
Venue:
Pattern Recognition Letters - Special issue on vision for crime detection and prevention
Year:
2006

Citing 13
Cited 0

The Design and Use of Steerable Filters

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active shape models—their training and application

Computer Vision and Image Understanding
Pfinder: Real-Time Tracking of the Human Body

IEEE Transactions on Pattern Analysis and Machine Intelligence
The visual analysis of human movement: a survey

Computer Vision and Image Understanding
Learning Patterns of Activity Using Real-Time Tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust Real-Time Periodic Motion Detection, Analysis, and Applications

IEEE Transactions on Pattern Analysis and Machine Intelligence
Statistical color models with application to skin detection

International Journal of Computer Vision
Contour Tracking by Stochastic Propagation of Conditional Density

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
Finding skin in color images

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Hand motion gestural oscillations and multimodal discourse

Proceedings of the 5th international conference on Multimodal interfaces
Blob Analysis of the Head and Hands: A Method for Deception Detection

HICSS '05 Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 1 - Volume 01
An Approach for Intent Identification by Building on Deception Detection

HICSS '05 Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 1 - Volume 01
A steerable complex wavelet construction and its application to image denoising

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe ongoing work into methods for the automated tracking of hand and finger movements in interview situations. The aim of this work is to aid visual behaviour analysis in studies of deception detection. Existing techniques for tracking hand and linger movements are reviewed to place current and future work into context. Posterior probability maps of skin tone, based on Parzen colour space probability density estimates, are used for initial hand segmentation. Blob features are then used to produce a markup of hand-states. A complex wavelet decomposition, coupled to weightings provided by the posterior probability map, is applied to detect small hand and finger movements. We discuss our hand tracking algorithm based on blob feature extraction and the results obtained from motion and orientation parameters in a "high-stakes experiment", designed around a real-life situation. We suggest the role of kinematic models of upper body, limb and finger motion for future work.