Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations
Journal of Computational Physics
Robust model-based motion tracking through the integration of search and estimation
International Journal of Computer Vision
Active vision
Efficient Region Tracking With Parametric Models of Geometry and Illumination
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model
International Journal of Computer Vision
Hyperplane Approximation for Template Matching
IEEE Transactions on Pattern Analysis and Machine Intelligence
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Randomized Trees for Real-Time Keypoint Recognition
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
A New Conjugate Gradient Method with Guaranteed Descent and an Efficient Line Search
SIAM Journal on Optimization
Fusing Points and Lines for High Performance Tracking
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation
International Journal of Computer Vision
Monocular model-based 3D tracking of rigid objects
Foundations and Trends® in Computer Graphics and Vision
International Journal of Computer Vision
Three-Dimensional Shape Knowledge for Joint Image Segmentation and Pose Tracking
International Journal of Computer Vision
Simultaneous Segmentation and Pose Estimation of Humans Using Dynamic Graph Cuts
International Journal of Computer Vision
IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part II
Robust 3D Pose Estimation and Efficient 2D Region-Based Segmentation from a 3D Shape Prior
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II
Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II
Parallel Tracking and Mapping for Small AR Workspaces
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Pose tracking from natural features on mobile phones
ISMAR '08 Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality
Combined Region and Motion-Based 3D Tracking of Rigid and Articulated Objects
IEEE Transactions on Pattern Analysis and Machine Intelligence
Occlusion modeling by tracking multiple objects
Proceedings of the 29th DAGM conference on Pattern recognition
Feature harvesting for tracking-by-detection
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
Nonlinear shape manifolds as shape priors in level set segmentation and tracking
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Markerless motion capture of interacting characters using multi-view image segmentation
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
3D hand tracking for human computer interaction
Image and Vision Computing
Simultaneous monocular 2d segmentation, 3d pose recovery and 3d reconstruction
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Hi-index | 0.00 |
We formulate a probabilistic framework for simultaneous region-based 2D segmentation and 2D to 3D pose tracking, using a known 3D model. Given such a model, we aim to maximise the discrimination between statistical foreground and background appearance models, via direct optimisation of the 3D pose parameters. The foreground region is delineated by the zero-level-set of a signed distance embedding function, and we define an energy over this region and its immediate background surroundings based on pixel-wise posterior membership probabilities (as opposed to likelihoods). We derive the differentials of this energy with respect to the pose parameters of the 3D object, meaning we can conduct a search for the correct pose using standard gradient-based non-linear minimisation techniques. We propose novel enhancements at the pixel level based on temporal consistency and improved online appearance model adaptation. Furthermore, straightforward extensions of our method lead to multi-camera and multi-object tracking as part of the same framework. The parallel nature of much of the processing in our algorithm means it is amenable to GPU acceleration, and we give details of our real-time implementation, which we use to generate experimental results on both real and artificial video sequences, with a number of 3D models. These experiments demonstrate the benefit of using pixel-wise posteriors rather than likelihoods, and showcase the qualities, such as robustness to occlusions and motion blur (and also some failure modes), of our tracker.