Accurate and efficient gesture spotting via pruning and subgesture reasoning

Authors:
Jonathan Alon;Vassilis Athitsos;Stan Sclaroff
Affiliations:
Computer Science Department, Boston University, Boston, MA;Computer Science Department, Boston University, Boston, MA;Computer Science Department, Boston University, Boston, MA
Venue:
ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction
Year:
2005

Citing 8
Cited 9

An HMM-Based Threshold Model Approach for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Statistical color models with application to skin detection

International Journal of Computer Vision
Computer vision for computer games

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
A Gesture Interface for Human-Robot-Interaction

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Real-time American Sign Language recognition from video using hidden Markov models

ISCV '95 Proceedings of the International Symposium on Computer Vision
Automatic 2D Hand Tracking in Video Sequences

WACV-MOTION '05 Proceedings of the Seventh IEEE Workshops on Application of Computer Vision (WACV/MOTION'05) - Volume 1 - Volume 01
Recognition-based gesture spotting in video games

Pattern Recognition Letters
Automated gesture segmentation from dance sequences

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Gesture spotting for low-resolution sports video annotation

Pattern Recognition
Approximate embedding-based subsequence matching of time series

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Translation and scale-invariant gesture recognition in complex scenes

Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
Recognizing events with temporal random forests

Proceedings of the 2009 international conference on Multimodal interfaces
Model-based segmentation and recognition of dynamic gestures in continuous video streams

Pattern Recognition
Gesture identification based on zone entry and axis crossing

HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
Robust player gesture spotting and recognition in low-resolution sports video

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Generalized Model-Based Human Motion Recognition with Body Partition Index Maps

Computer Graphics Forum
Most discriminating segment - Longest common subsequence (MDSLCS) algorithm for dynamic hand gesture classification

Pattern Recognition Letters

Quantified Score

Hi-index	0.04

Visualization

Abstract

Gesture spotting is the challenging task of locating the start and end frames of the video stream that correspond to a gesture of interest, while at the same time rejecting non-gesture motion patterns. This paper proposes a new gesture spotting and recognition algorithm that is based on the continuous dynamic programming (CDP) algorithm, and runs in real-time. To make gesture spotting efficient a pruning method is proposed that allows the system to evaluate a relatively small number of hypotheses compared to CDP. Pruning is implemented by a set of model-dependent classifiers, that are learned from training examples. To make gesture spotting more accurate a subgesture reasoning process is proposed that models the fact that some gesture models can falsely match parts of other longer gestures. In our experiments, the proposed method with pruning and subgesture modeling is an order of magnitude faster and 18% more accurate compared to the original CDP algorithm.