Extraction of 3D Hand Shape and Posture from Image Sequences for Sign Language Recognition

  • Authors:
  • Holger Fillbrandt;Suat Akyol;Karl-Friedrich Kraiss

  • Affiliations:
  • -;-;-

  • Venue:
  • AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a novel method for extracting natural hand parametersfrom monocular image sequences. The purpose is to improve avision-based sign language recognition system by providing detailinformation about the finger constellation and the 3D hand posture.There for the hand is modelled by a set of 2D appearance models,each representing a limited variation range of 3D hand shape andposture. The single models are linked to each other according tothe natural neighbourhood of the corresponding hand status. Duringan image sequence, necessary model transitions are executed towardsone of the current neighbour models. The natural hand parametersare calculated from the shape and texture parameters of the currentmodel, using a relation estimated by linear regression. The methodis robust against large differences between subsequent frames andalso against poor image quality. It can be implemented in real-timeand offers good properties to handle occlusion and partly missingimage information.