Lip segmentation and tracking under MAP-MRF framework with unknown segment number

Authors:
Yiu-Ming Cheung;Meng Li;Xiaochun Cao
Affiliations:
Department of Computer Science, Hong Kong Baptist University, Hong Kong, China;Department of Computer Science, Hong Kong Baptist University, Hong Kong, China;State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100093, China
Venue:
Neurocomputing
Year:
2013

Citing 34
Cited 0

Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active shape models—their training and application

Computer Vision and Image Understanding
The quickhull algorithm for convex hulls

ACM Transactions on Mathematical Software (TOMS)
Speechreading using probabilistic models

Computer Vision and Image Understanding - Special issue on physics-based modeling and reasoning in computer vision
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Morphological Image Analysis: Principles and Applications

Morphological Image Analysis: Principles and Applications
An Approach to Statistical Lip Modelling for Speaker Identification via Chromatic Feature Extraction

ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 1 - Volume 1
Computer Graphics and Geometric Modelling: Implementation & Algorithms

Computer Graphics and Geometric Modelling: Implementation & Algorithms
Maximum Weighted Likelihood via Rival Penalized EM for Density Mixture Clustering with Automatic Model Selection

IEEE Transactions on Knowledge and Data Engineering
Digital Image Processing (3rd Edition)

Digital Image Processing (3rd Edition)
Real Time Tracking for 3D Realistic Lip Animation

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
Robust lip region segmentation for lip images with complex background

Pattern Recognition
Statistical lip-appearance models trained automatically using audio information

EURASIP Journal on Applied Signal Processing
Colour and Geometric based Model for Lip Localisation: Application for Lip-reading System

ICIAP '07 Proceedings of the 14th International Conference on Image Analysis and Processing
Automatically Determining the Number of Clusters in Unlabeled Data Sets

IEEE Transactions on Knowledge and Data Engineering
Markov Random Field Modeling in Image Analysis

Markov Random Field Modeling in Image Analysis
A selection model for optimal fuzzy clustering algorithm and number of clusters based on competitive comprehensive fuzzy evaluation

IEEE Transactions on Fuzzy Systems
Inference and parameter estimation on hierarchical belief networks for image segmentation

Neurocomputing
Automatic lip contour extraction from color images

Pattern Recognition
A review of active appearance models

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A unified tensor level set for image segmentation

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on game theory
Detecting the Number of Clusters in n-Way Probabilistic Clustering

IEEE Transactions on Pattern Analysis and Machine Intelligence
3D human posture segmentation by spectral clustering with surface normal constraint

Signal Processing
Color image segmentation using automatic pixel classification with support vector machine

Neurocomputing
A multi-layer MRF model for video object segmentation

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
Audio-visual speech modeling for continuous speech recognition

IEEE Transactions on Multimedia
A Relay Level Set Method for Automatic Image Segmentation

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Segmentation of color lip images by spatial fuzzy clustering

IEEE Transactions on Fuzzy Systems
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Lip image segmentation using fuzzy clustering incorporating an elliptic shape function

IEEE Transactions on Image Processing
Nonlinear color space and spatiotemporal MRF for hierarchical segmentation of face features in video

IEEE Transactions on Image Processing
Discriminative Analysis of Lip Motion Features for Speaker Identification and Speech-Reading

IEEE Transactions on Image Processing
A Segmentation Model Using Compound Markov Random Fields Based on a Boundary Model

IEEE Transactions on Image Processing
Rival penalized competitive learning for clustering analysis, RBF net, and curve detection

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper proposes a color lip segmentation method with unknown true segment number. Firstly, we build up a multi-layer hierarchical model, in which each layer corresponds to one segment cluster. Subsequently, a Markov random field derived from this model is obtained such that the segmentation problem is formulated as a labeling optimization problem under the maximum a posteriori Markov random field (MAP-MRF) framework. Suppose the pre-assigned number of segment clusters may over-estimate the ground truth, whereby leading to the over-segmentation. We present a rival penalized iterative algorithm capable of performing segment clusters and over-segmentation elimination simultaneously. Based upon this algorithm, we propose a lip segmentation and tracking scheme, featuring the robust performance to the estimate of the number of segment clusters. Experimental results show the efficacy of the proposed method in comparison with the existing counterparts.