Extraction and Classification of Visual Motion Patterns for Hand Gesture Recognition

  • Authors:
  • M. -H. Yang;N. Ahuja

  • Affiliations:
  • -;-

  • Venue:
  • CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
  • Year:
  • 1998

Quantified Score

Hi-index 0.01

Visualization

Abstract

We present a new method for extracting and classifying motion patterns to recognize hand gestures. First, motion segmentatzon of the image sequence is generated based on a muttiscale transform and attributed graph matching of regions across frames. This produces region correspondences and their affine transformations. Second, color information of motion regions is used to determine skin regions. Third, human head and palm regions are identified based on the shape and size of skin areas in motion. Finally, affine transformations defining a region's motion between successive frames are concatenated to construct the region's motion trajectory. Gestural motion trajectories are then classified by a time-delay neural network trained with backpropagation learning algorithm. Our experimental results show that hand gestures can be recognized well using motion patterns.