A Method for Registration of 3-D Shapes
IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Iterative point matching for registration of free-form curves and surfaces
International Journal of Computer Vision
The computation of optical flow
ACM Computing Surveys (CSUR)
Multiresolution analysis of arbitrary meshes
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Coding, Analysis, Interpretation, and Recognition of Facial Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
3D lip shapes from video: a combined physical-statistical model
Speech Communication - Special issue on auditory-visual speech processing
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Real-time 3D model acquisition
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Adjusting Shape Parameters Using Model-Based Optical Flow Residuals
IEEE Transactions on Pattern Analysis and Machine Intelligence
International Journal of Computer Vision
Subtly Different Facial Expression Recognition and Expression Intensity Estimation
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Recovery and Tracking of Continuous 3D Surfaces from Stereo Data Using a Deformable Dual-Mesh
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Statistical Cue Integration in DAG Deformable Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
The space of human body shapes: reconstruction and parameterization from range scans
ACM SIGGRAPH 2003 Papers
Face Recognition Based on Fitting a 3D Morphable Model
IEEE Transactions on Pattern Analysis and Machine Intelligence
Surface Classification Using Conformal Structures
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
3D Tracking = Classification + Interpolation
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Capturing Subtle Facial Motions in 3D Face Tracking
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
A Hierarchical Framework For High Resolution Facial Expression Tracking
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 1 - Volume 01
High-Resolution, Real-time 3D Shape Acquisition
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 3 - Volume 03
Three-Dimensional Face Recognition
International Journal of Computer Vision
Efficient Computation of Isometry-Invariant Distances Between Surfaces
SIAM Journal on Scientific Computing
An image processing approach to surface matching
SGP '05 Proceedings of the third Eurographics symposium on Geometry processing
2D-shape analysis using conformal mapping
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Real-time combined 2D+3D active appearance models
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Accurate face models from uncalibrated and Ill-Lit video sequences
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
The Digital Emily project: photoreal facial modeling and animation
ACM SIGGRAPH 2009 Courses
Tracking vertex flow and model adaptation for three-dimensional spatiotemporal face analysis
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans - Special issue on recent advances in biometrics
Modeling 3D facial expressions using geometry videos
Proceedings of the international conference on Multimedia
3D facial feature detection using iso-geodesic stripes and shape-index based integral projection
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part II
Modeling 3D articulated motions with conformal geometry videos (CGVs)
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Static and dynamic 3D facial expression recognition: A comprehensive survey
Image and Vision Computing
Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis
Image and Vision Computing
ElastiFace: matching and blending textured faces
Proceedings of the Symposium on Non-Photorealistic Animation and Rendering
Hyperbolic harmonic brain surface registration with curvature-based landmark matching
IPMI'13 Proceedings of the 23rd international conference on Information Processing in Medical Imaging
Hi-index | 0.00 |
We present a novel automatic method for high resolution, non-rigid dense 3D point tracking. High quality dense point clouds of non-rigid geometry moving at video speeds are acquired using a phase-shifting structured light ranging technique. To use such data for the temporal study of subtle motions such as those seen in facial expressions, an efficient non-rigid 3D motion tracking algorithm is needed to establish inter-frame correspondences. The novelty of this paper is the development of an algorithmic framework for 3D tracking that unifies tracking of intensity and geometric features, using harmonic maps with added feature correspondence constraints. While the previous uses of harmonic maps provided only global alignment, the proposed introduction of interior feature constraints allows to track non-rigid deformations accurately as well. The harmonic map between two topological disks is a diffeomorphism with minimal stretching energy and bounded angle distortion. The map is stable, insensitive to resolution changes and is robust to noise. Due to the strong implicit and explicit smoothness constraints imposed by the algorithm and the high-resolution data, the resulting registration/deformation field is smooth, continuous and gives dense one-to-one inter-frame correspondences. Our method is validated through a series of experiments demonstrating its accuracy and efficiency.