Body posture estimation in sign language videos

  • Authors:
  • François Lefebvre-Albaret;Patrice Dalle

  • Affiliations:
  • IRIT : UPS-118 r. de Narbonne, Toulouse cedex 9;IRIT : UPS-118 r. de Narbonne, Toulouse cedex 9

  • Venue:
  • GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article deals with the posture reconstruction from a mono view video of a signed utterance. Our method makes no use of additional sensors or visual markers. The head and the two hands are tracked by means of a particle filter. The elbows are detected as convolution local maxima. A non linear filter is first used to remove the outliers, then some criteria using French Sign Language phonology are used to process the hand disambiguation. The posture reconstruction is achieved by using inverse kinematics, using a Kalman smoothing and the correlation between strong and week hand depth that can be noticed in the signed utterances. The article ends with a quantitative and qualitative evaluation of the reconstruction. We show how the results could be used in the framework of automatic Sign Language video processing.