Recognition-based gesture spotting in video games

Authors:
Hyun Kang;Chang Woo Lee;Keechul Jung
Affiliations:
Department of Computer Engineering, Kyungpook National University, Sankyuk Dong, Daegu, South Korea;Department of Computer Engineering, Kyungpook National University, Sankyuk Dong, Daegu, South Korea;School of Media, College of Information Science, Soongsil University, Seoul, South Korea
Venue:
Pattern Recognition Letters
Year:
2004

Citing 12
Cited 23

Toward a vision-based hand gesture interface

VRST '94 Proceedings of the conference on Virtual reality software and technology
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Vision-based 3-D tracking of humans in action

Vision-based 3-D tracking of humans in action
Segmentation of touching characters using an MLP

Pattern Recognition Letters
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
An HMM-Based Threshold Model Approach for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer Vision for Interactive Computer Graphics

IEEE Computer Graphics and Applications
Speech/Gesture Interface to a Visual-Computing Environment

IEEE Computer Graphics and Applications
Real-Time Face Detection and Tracking Using PCA and NN

PRICAI '02 Proceedings of the 7th Pacific Rim International Conference on Artificial Intelligence: Trends in Artificial Intelligence
Vision-Based Gesture Recognition: A Review

GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Recognizing Temporal Trajectories Using the Condensation Algorithm

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Design of an interface on PDA for Korean

IEEE Transactions on Consumer Electronics

Simultaneous gesture segmentation and recognition based on forward spotting accumulative HMMs

Pattern Recognition
Depth silhouettes for gesture recognition

Pattern Recognition Letters
Real time gesture recognition using continuous time recurrent neural networks

Proceedings of the ICST 2nd international conference on Body area networks
Gesture Recognition for a Webcam-Controlled First Person Shooter

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
Appearance based recognition methodology for recognising fingerspelling alphabets

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Rejection of non-meaningful activities for HMM-based activity recognition system

Image and Vision Computing
Continuous stereo gesture recognition with multi-layered silhouette templates and support vector machines

MICAI'07 Proceedings of the artificial intelligence 6th Mexican international conference on Advances in artificial intelligence
Cyclic and non-cyclic gesture spotting and classification in real-time applications

AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Vision-based hand-gesture applications

Communications of the ACM
Model-based segmentation and recognition of dynamic gestures in continuous video streams

Pattern Recognition
A spanning tree-based human activity prediction system using life logs from depth silhouette-based human activity recognition

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part I
Feature fusion for 3D hand gesture recognition by learning a shared hidden space

Pattern Recognition Letters
Accurate and efficient gesture spotting via pruning and subgesture reasoning

ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction
Gesturing in the wild: understanding the effects and implications of gesture-based interaction for dynamic presentations

BCS '10 Proceedings of the 24th BCS Interaction Specialist Group Conference
Vision-Based game interface using human gesture

PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
Shape from pairwise silhouettes for plan-view map generation

Image and Vision Computing
A hierarchical approach to continuous gesture analysis for natural multi-modal interaction

Proceedings of the 14th ACM international conference on Multimodal interaction
Locally regularized sliced inverse regression based 3D hand gesture recognition on a dance robot

Information Sciences: an International Journal
Connecting users to virtual worlds within MPEG-V standardization

Image Communication
Review: Engineering design using game-enhanced CAD: The potential to augment the user experience with game elements

Computer-Aided Design
Unsupervised adaptation for acceleration-based activity recognition: robustness to sensor displacement and rotation

Personal and Ubiquitous Computing
HEGM: A hierarchical elastic graph matching for hand gesture recognition

Pattern Recognition
Touchless interaction in surgery

Communications of the ACM

Quantified Score

Hi-index	0.13

Visualization

Abstract

In vision-based interfaces for video games, gestures are used as commands for the games instead of pressing buttons on a keyboard or moving a mouse. In these interfaces, unintentional movements and continuous gestures must be supported to provide the user with a more natural interface. This paper proposes a novel gesture spotting method that combines gesture spotting with gesture recognition. It recognizes the meaningful movements while concurrently separating unintentional movements from a given image sequence. We applied our method to the recognition of upper-body gestures as the interface between a video game (Quake II) and its user. Experimental results show that the proposed method is, on average, 93.36% reliable in spotting gestures from continuous gestures, confirming its potential for a gesture-based interface for computer games.