Gesture recognition using auto-regressive coefficients of higher-order local auto-correlation features

Authors:
Tatsuya Ishihara;Nobuyuki Otsu
Affiliations:
Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan;Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan and National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki, Japan
Venue:
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Year:
2004

Citing 5
Cited 4

Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
User-independent online gesture recognition by relative motion extraction

Pattern Recognition Letters
Coupled hidden Markov models for complex action recognition

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Gesture Recognition Using HLAC Features of PARCOR Images and HMM Based Recognizer

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Learning dynamics for exemplar-based gesture recognition

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Three-way auto-correlation approach to motion recognition

Pattern Recognition Letters
Visual sign language recognition based on HMMs and auto-regressive HMMs

GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation
Bimanual hand tracking

ICCSA'06 Proceedings of the 6th international conference on Computational Science and Its Applications - Volume Part I
Motion recognition using local auto-correlation of space-time gradients

Pattern Recognition Letters

Quantified Score

Hi-index	0.01

Visualization

Abstract

We propose an efficient method for motion recognition from time-varying images. The method extracts Higher-order Local Auto-Correlation (HLAC) features from time differential images in a time series. An Auto-Regressive model is applied to each dimension of the HLAC features and AR coefficients are calculated to achieve efficient extraction of information over a time range within a (time) window. These features become high dimensional feature vectors, so we use discriminant analysis to obtain effective less-dimensional features. These features are learned by the Hidden Markov Model (HMM) based recognizer to cope with non-uniformity of the speed of motions. We applied this method to gesture recognition and obtained good results. Because HLAC features are location-invariant, our method is robust to position changes of the objects (humans) in the image and need no segmentation of the objects. In addition, since the method extracts features from time differential images, it is also robust to changes of background and illumination condition. The method does not necessitate any a priori knowledge about objects in images; therefore, it may be applied to various applications of motion recognition, such as lip-reading, sign language recognition, and so forth.