An integrated sign language recognition system

  • Authors:
  • Warren Nel;Mehrdad Ghaziasgar;James Connan

  • Affiliations:
  • University of Western Cape, Bellville;University of Western Cape, Bellville;Rhodes University, Grahamstown

  • Venue:
  • Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The South African Sign Language research group at the University of the Western Cape has created several systems to recognize Sign Language gestures using single parameters. Research has shown that five parameters are required to recognize any sign language gesture: hand shape, location, orientation and motion, as well as facial expressions. Using a single parameter can cause conflicts in recognition of signs that are similarly signed. This paper pioneers research at the group towards combining multiple parameters to better distinguish between similar signs. This eventually aims to enable the recognition of a large SASL vocabulary. The proposed methodology combines hand location and hand shape recognition into one combined recognition system. The recognition approach is applied to 12 SASL signs that consist of six pairs of signs with the same hand shape performed at two different locations. It is shown that the approach is able to achieve a high average recognition accuracy of 79% across all signs and distinguish between the signs effectively. It is also shown to be robust to variations in test subjects.