Generating Data for Signer Adaptation

  • Authors:
  • Chunli Wang;Xilin Chen;Wen Gao

  • Affiliations:
  • School of Computer Science and Technology, Dalian Maritime University, Dalian, China 116026;Institute of Computing Technology, Chinese Academy of Science, Beijing, China 100080;School of Electronics Engineering and Computer Science, Peking University, China

  • Venue:
  • Gesture-Based Human-Computer Interaction and Simulation
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In sign language recognition (SLR), one of the problems is signer adaptation. Different from spoken language, there are lots of "phonemes" in sign language. It is not convenient to collect enough data to adapt the system to a new signer. A method of signer adaptation with little data for continuous density hidden Markov models (HMMs) is presented. Firstly, hand shapes, positions and orientations that compose all sign words are extracted with clustering algorithm. They are regarded as basic units. Based on a small number of sign words that include these basic units, the adaptation data of all sign words are generated. Statistics are gathered from the generated data and used to calculate a linear regression-based transformation for the mean vectors. To verify the effectiveness of the proposed method, some experiments are carried out on a vocabulary with 350 sign words in Chinese Sign Language (CSL). All basic units of hand shape, position and orientation are found. With these units, we generate the adaptation data of 350 sign words. Experimental results demonstrate that the proposed method has similar performance compared with that using the original samples of 350 sign words as adaptation data.