Colour and Geometric based Model for Lip Localisation: Application for Lip-reading System

  • Authors:
  • Salah Werda;Walid Mahdi;Abdelmajid Ben Hamadou

  • Affiliations:
  • MIRACL, Higher Institute of Computer Science and Multimedia, Tunisia;MIRACL, Higher Institute of Computer Science and Multimedia, Tunisia;MIRACL, Higher Institute of Computer Science and Multimedia, Tunisia

  • Venue:
  • ICIAP '07 Proceedings of the 14th International Conference on Image Analysis and Processing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motivated by humans' ability to lipread, the visual component is considered to yield information in the speech recognition system. The lip-reading is the perception of the speech purely based on observing the talker lip movements. The major difficulty of the lipreading system is the extraction of the visual speech descriptors. In fact, to ensure this task it is necessary to carry out an automatic localization and tracking of the labial gestures. We present in this paper a new automatic approach for lip and point of interest localization on a speaker's face based both on the color information of mouth and a geometric model of lips. This hybrid solution makes our method more tolerant to noise and artifacts in the image. Experiments revealed that our lip POI localization approach for lip-reading purpose is promising. The presented Results show that our system recognizes 94.64 % of French visemes.