Hand posture matching for Irish Sign language interpretation

  • Authors:
  • G. Somers;R. N. Whyte

  • Affiliations:
  • Institute of Technology Carlow, Co. Carlow, Ireland;Institute of Technology Carlow, Co. Carlow, Ireland

  • Venue:
  • ISICT '03 Proceedings of the 1st international symposium on Information and communication technologies
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

A major part of any sign language interpreter is the identification of the posture of the signer's hand. This is a complicated task due to the large variety of postures and orientations that a human hand can achieve. In this paper we present a method that we are implementing as part of an overall Irish sign language interpreter. Our method uses a set of three-dimensional hand models that are orientated at run time to match the orientation of a signer's hand. The orientation is defined by a pre-existing feature of our overall Sign Language Interpreter System. These models are then rendered to create a set of silhouettes for matching against a signer's hand silhouette that is extracted from the image. To overcome the problem of loosing finger information in a silhouette, we make use of a stereo camera setup to match two silhouettes created from images taken at two diverse angles. The matching is done using a Chamfer Distance algorithm, to determine the closeness of a match. Using a hand path identifier, which forms part of the Irish Sign Language Interpreter, we are able to reduce the set of postures under consideration. This reduces the number of comparisons needed during matching. We show that the use of our stereo image system enables us to achieve improved performance over a single camera setup and achieve a more reliable match.