Incremental perspective motion model for rigid and non-rigid motion separation

Authors:
Tzung-Heng Lai;Te-Hsun Wang;Jenn-Jier James Lien
Affiliations:
Robotics Laboratory, CSIE, NCKU, Tainan, Taiwan, R.O.C.;Robotics Laboratory, CSIE, NCKU, Tainan, Taiwan, R.O.C.;Robotics Laboratory, CSIE, NCKU, Tainan, Taiwan, R.O.C.
Venue:
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Year:
2007

Citing 13
Cited 0

Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow

IEEE Transactions on Pattern Analysis and Machine Intelligence
Creating full view panoramic image mosaics and environment maps

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion

International Journal of Computer Vision
Hierarchical Model-Based Motion Estimation

ECCV '92 Proceedings of the Second European Conference on Computer Vision
Subtly Different Facial Expression Recognition and Expression Intensity Estimation

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
A Probabilistic Framework for Rigid and Non-Rigid Appearance Based Tracking and Recognition

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
An Approach to Automatic Recognition of Spontaneous Facial Actions

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Model-Based Face Tracking for View-Independent Facial Expression Recognition

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Evaluation of Gabor-Wavelet-Based Facial Action Unit Recognition in Image Sequences of Increasing Complexity

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence
AAM Derived Face Representations for Robust Facial Action Recognition

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Fully Automatic Facial Action Recognition in Spontaneous Behavior

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
A real-time automated system for the recognition of human facial expressions

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Motion extraction is an essential work in facial expression analysis because facial expression usually experiences rigid head rotation and non-rigid facial expression simultaneously. We developed a system to separate non-rigid motion from large rigid motion over an image sequence based on the incremental perspective motion model. Since the parameters of this motion model are able to not only represnt the global rigid motion but also localize the non-rigid motion, thus this motion model overcomes the limitations of existing methods, the affine model and the 8-parameter perspective projection model, in large head rotation angles. In addition, since the gradient descent approach is susceptible to local minimum during the motion parameter estimation process, a multi-resolution approach is applied to optimize initial values of parameters at the coarse level. Finally, the experimental result shows that our model has promising performance of separating non-rigid motion from rigid motion.