Multimodal speaker/speech recognition using lip motion, lip texture and audio
Signal Processing - Special section: Multimodal human-computer interfaces
International Journal of Approximate Reasoning
Integrated Computer-Aided Engineering
Image and video for hearing impaired people
Journal on Image and Video Processing
Intelligent Assistive Exoskeleton with Vision Based Interface
ICOST '08 Proceedings of the 6th international conference on Smart Homes and Health Telematics
Lip contour extraction using level set curve evolution with shape constraint
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
A new manifold representation for visual speech recognition
CAIP'07 Proceedings of the 12th international conference on Computer analysis of images and patterns
Inner and outer lip contour tracking using cubic curve parametric models
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Combining edge detection and region segmentation for lip contour extraction
AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Belief theory applied to facial expressions classification
ICAPR'05 Proceedings of the Third international conference on Pattern Recognition and Image Analysis - Volume Part II
Attractor-Guided particle filtering for lip contour tracking
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
Facial expression recognition based on the belief theory: comparison with different classifiers
ICIAP'05 Proceedings of the 13th international conference on Image Analysis and Processing
A local region based approach to lip tracking
Pattern Recognition
Automatic detailed localization of facial features
IEA/AIE'12 Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence
| Hi-index | 0.00 |
Lip segmentation is an essential stage in many multimedia systems such as videoconferencing, lip reading, or low-bit-rate coding communication systems. In this paper, we propose an accurate and robust quasi-automatic lip segmentation algorithm. First, the upper mouth boundary and several characteristic points are detected in the first frame by using a new kind of active contour: the "jumping snake." Unlike classic snakes, it can be initialized far from the final edge and the adjustment of its parameters is easy and intuitive. Then, to achieve the segmentation, we propose a parametric model composed of several cubic curves. Its high flexibility enables accurate lip contour extraction even in the challenging case of a very asymmetric mouth. Compared to existing models, it brings a significant improvement in accuracy and realism. The segmentation in the following frames is achieved by using an interframe tracking of the keypoints and the model parameters. However, we show that, with a usual tracking algorithm, the keypoints' positions become unreliable after a few frames. We therefore propose an adjustment process that enables an accurate tracking even after hundreds of frames. Finally, we show that the mean keypoints' tracking errors of our algorithm are comparable to manual points' selection errors.