Accessible motion-capture glove calibration protocol for recording sign language data from deaf subjects

  • Authors:
  • Pengfei Lu;Matt Huenerfauth

  • Affiliations:
  • The City University of New York, Graduate Center, New York, NY, USA;The City University of New York, Queens College, Flushing, NY, USA

  • Venue:
  • Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motion-capture recordings of sign language are used in research on automatic recognition of sign language or generation of sign language animations, which have accessibility applications for deaf users with low levels of written-language literacy. Motion-capture gloves are used to record the wearer's handshape. Unfortunately, these gloves require a time-consuming and inexact manual calibration process each time they are worn. This paper describes the design and evaluation of a new calibration protocol for motion-capture gloves, which is designed to make the process more efficient and to be accessible for participants who are deaf and use American Sign Language (ASL). The protocol was evaluated experimentally; deaf ASL signers wore the gloves, were calibrated (using the new protocol and using a calibration routine provided by the glove manufacturer), and were asked to perform sequences of ASL handshapes. A native ASL signer rated the correctness and understandability of the collected handshape data. The new protocol received significantly higher scores than the standard calibration. The protocol has been made freely available online, and it includes directions for the researcher, images and videos of how participants move their hands during the process, and directions for participants (as ASL videos and English text).