Hands and face tracking for VR applications

Authors:
Javier Varona;José M. Buades;Francisco J. Perales
Affiliations:
Unidad de Gráficos y Visión por Ordenador, Dept. de matematiques i Informatica, Universitat de les Illes Balears (UIB), crta. Valldemossa km. 7,5, 07122 Palma de Mallorca, Spain;Unidad de Gráficos y Visión por Ordenador, Dept. de matematiques i Informatica, Universitat de les Illes Balears (UIB), crta. Valldemossa km. 7,5, 07122 Palma de Mallorca, Spain;Unidad de Gráficos y Visión por Ordenador, Dept. de matematiques i Informatica, Universitat de les Illes Balears (UIB), crta. Valldemossa km. 7,5, 07122 Palma de Mallorca, Spain
Venue:
Computers and Graphics
Year:
2005

Citing 5
Cited 4

Pfinder: Real-Time Tracking of the Human Body

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Robust Detection and Tracking of Human Faces with an Active Camera

VS '00 Proceedings of the Third IEEE International Workshop on Visual Surveillance (VS'2000)
Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Real-Time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition

Temporal Nearest End-Effectors for Real-Time Full-Body Human Actions Recognition

AMDO '08 Proceedings of the 5th international conference on Articulated Motion and Deformable Objects
Kinetic Pseudo-energy History for Human Dynamic Gestures Recognition

AMDO '08 Proceedings of the 5th international conference on Articulated Motion and Deformable Objects
Toward natural interaction through visual recognition of body gestures in real-time

Interacting with Computers
Motion capture for clinical purposes, an approach using primesense sensors

AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present a robust real-time 3D tracking system of human hands and face. This system can be used as a perceptual interface for virtual reality activities in a workbench environment. The main advantage of our system is that the human, placed in front of the virtual reality device, does not need any type of marker or special suit. The system includes a colour segmentation module to detect in real-time the skin-colour pixels present in the images. The results of this skin-colour segmentation will be skin-colour blobs, these are the inputs of a data association module. This module labels the blobs pixels using a set of hypothesis from previous frames. The 2D-tracking results are used for the 3D reconstruction of hands and face in order to obtain the 3D positions of these limbs. Finally, we present several results using the H-ANIM standard to show the system's output performance.