Gesture Recognition for a Webcam-Controlled First Person Shooter

Authors:
Robert W. Wilson;Andrea Salgian
Affiliations:
Department of Computer Science, The College of New Jersey, Ewing NJ 08628;Department of Computer Science, The College of New Jersey, Ewing NJ 08628
Venue:
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
Year:
2008

Citing 6
Cited 0

Statistical color models with application to skin detection

International Journal of Computer Vision
Computer Vision for Interactive Computer Graphics

IEEE Computer Graphics and Applications
A Probabilistic Framework for Matching Temporal Trajectories: CONDENSATION-Based Recognition of Gestures and Expressions

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Action Recognition Using Probabilistic Parsing

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Gesture Modeling and Recognition Using Finite State Machines

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Recognition-based gesture spotting in video games

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we describe a vision-based interface for a video game that relies on gestures that are made up of one pose that the player needs to hold as long as the corresponding action is desired. These gestures are easy to learn, perform and detect. After a background subtraction and skin detection stage, the method tracks the face and hands of the player by approximating them with ellipses that are updated from frame to frame. Gestures are recognized using a grid that is anchored to the player's face. The system is very robust, has a low tracking error, and a 97% recognition rate.