Lipreading procedure based on dynamic programming

Authors:
Agnieszka Owczarek;Krzysztof Ślot
Affiliations:
Institute of Electronics, Technical University of Lodz, Lodz, Poland;Institute of Electronics, Technical University of Lodz, Lodz, Poland
Venue:
ICAISC'12 Proceedings of the 11th international conference on Artificial Intelligence and Soft Computing - Volume Part I
Year:
2012

Citing 6
Cited 0

Robust Real-Time Face Detection

International Journal of Computer Vision
Synergy of Lip-Motion and Acoustic Features in Biometric Speech and Speaker Recognition

IEEE Transactions on Computers
Lip-reading with discriminative deformable models

Machine Graphics & Vision International Journal
Audio-visual speech modeling for continuous speech recognition

IEEE Transactions on Multimedia
A review of speech-based bimodal recognition

IEEE Transactions on Multimedia
Lipreading from color video

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The following paper describes a novel lipreading procedure based on dynamic programming. We proposed a new method of outer lip contour extraction and representation. Lip shapes, corresponding to selected group of visems, are firstly extracted using dynamic programming and then approximated by B-splines. Coordinates of B-spline control points form final feature vector used for visem recognition task. The discontinuity of lip gradient image is addressed by dynamic programming technique. This has the advantage of global minimum detection and consequently optimal lip contour extraction. Experiments for Polish language utterances show that seven classes of visems can be recognized with 75% accuracy.