Lip contour extraction for language learning in VEC3D

Authors:
Mau-Tsuen Yang;Zhen-Wei You;Ya-Chun Shih
Affiliations:
National Dong Hwa University, Department of Computer Science and Information Engineering, Hualien, Taiwan;National Dong Hwa University, Department of Computer Science and Information Engineering, Hualien, Taiwan;National Hualien University of Education, Department of English, Hualien, Taiwan
Venue:
Machine Vision and Applications
Year:
2009

Citing 9
Cited 1

Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Xface: MPEG-4 based open source toolkit for 3D Facial Animation

Proceedings of the working conference on Advanced visual interfaces
Automatic snakes for robust lip boundaries extraction

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 06
Moving-talker, speaker-independent feature study, and baseline results using the CUAVE multimodal speech corpus

EURASIP Journal on Applied Signal Processing
Audio-visual speech recognition using MPEG-4 compliant visual features

EURASIP Journal on Applied Signal Processing
Robust lip contour extraction using separability of multi-dimensional distributions

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Lip image segmentation using fuzzy clustering incorporating an elliptic shape function

IEEE Transactions on Image Processing
The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces

IEEE Transactions on Circuits and Systems for Video Technology

GPU accelerated image processing for lip segmentation

PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Lip image analysis is a critical problem in many vision-based applications such as lip reading, speaker authentication, video conferencing and language learning. We design three dynamic probability maps based on the color, shape, and edge features, respectively. These probability maps are then utilized to extract both inner and outer lip contours using a grid-based gradient-ascent approach. The experiments show that the proposed algorithm can extract inner/outer lip contours efficiently and reliably. The proposed lip contour extraction algorithm is applied successfully in a language-learning application called VEC3D.