Lipreading method using color extraction method and eigenspace technique

  • Authors:
  • Yasuyuki Nakata;Moritoshi Ando

  • Affiliations:
  • Fujitsu Laboratories Ltd., Atsugi, 243-0197 Japan;Fujitsu Laboratories Ltd., Atsugi, 243-0197 Japan

  • Venue:
  • Systems and Computers in Japan
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a lipreading system using a color extraction method and several eigenspace techniques. To detect a precise mouth position, the system first finds the rough position of the mouth by the color extraction method and then determines the precise position using an eigentemplate technique. To describe the mouth shape change, we developed an eigen waveform technique. The detected precise mouth position improves the accuracy of the eigen waveform, which results in a high recognition rate. We constructed an automatic lipreading system and an experiment revealed that this system recognizes 85% of 35 words and 69% of 100 words. © 2004 Wiley Periodicals, Inc. Syst Comp Jpn, 35(3): 12–23, 2004; Published online in Wiley InterScience (). DOI 10.1002/scj.10508