Adaptive view-based appearance models

Authors:
Louis-Philippe Morency;Ali Rahimi;Trevor Darrell
Affiliations:
MIT Artificial Intelligence Laboratory, Cambridge, MA;MIT Artificial Intelligence Laboratory, Cambridge, MA;MIT Artificial Intelligence Laboratory, Cambridge, MA
Venue:
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Year:
2003

Citing 12
Cited 37

Efficient Region Tracking With Parametric Models of Geometry and Illumination

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Adjusting Shape Parameters Using Model-Based Optical Flow Residuals

IEEE Transactions on Pattern Analysis and Machine Intelligence
Structure from Motion Causally Integrated Over Time

IEEE Transactions on Pattern Analysis and Machine Intelligence
LAFTER: Lips and Face Real-Time Tracker

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Parametrized structure from motion for 3D adaptive feedback tracking of faces

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Elliptical Head Tracking Using Intensity Gradients and Color Histograms

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
View-Based Active Appearance Models

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Motion Regularization for Model-Based Head Tracking

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Stereo Tracking Using ICP and Normal Flow Constraint

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4 - Volume 4
Robust Real-Time Face Detection

International Journal of Computer Vision

Pose Estimation using 3D View-Based Eigenspaces

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
A multi-modal approach for determining speaker location and focus

Proceedings of the 5th international conference on Multimodal interfaces
Where to look: a study of human-robot engagement

Proceedings of the 9th international conference on Intelligent user interfaces
Nodding in conversations with a robot

CHI '04 Extended Abstracts on Human Factors in Computing Systems
From conversational tooltips to grounded discourse: head poseTracking in interactive dialog systems

Proceedings of the 6th international conference on Multimodal interfaces
Robots as laboratory hosts

interactions - Robots!
Automatic video editing system using stereo-based head tracking for multiparty conversation

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Towards a model of face-to-face grounding

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Contextual recognition of head gestures

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Head gesture recognition in intelligent interfaces: the role of context in improving recognition

Proceedings of the 11th international conference on Intelligent user interfaces
Co-Adaptation of audio-visual speech and gesture classifiers

Proceedings of the 8th international conference on Multimodal interfaces
Recognizing gaze aversion gestures in embodied conversational discourse

Proceedings of the 8th international conference on Multimodal interfaces
Head gestures for perceptual interfaces: The role of context in improving recognition

Artificial Intelligence
Hidden Conditional Random Fields

IEEE Transactions on Pattern Analysis and Machine Intelligence
Detecting communication errors from visual cues during the system's conversational turn

Proceedings of the 9th international conference on Multimodal interfaces
Reducing drift in differential tracking

Computer Vision and Image Understanding
Walking Appearance Manifolds without Falling Off

Neural Information Processing
The role of context in head gesture recognition

AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Robust object tracking with a case-base updating strategy

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Real-time face and object tracking

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Recognizing engagement in human-robot interaction

Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Monocular head pose estimation using generalized adaptive view-based appearance model

Image and Vision Computing
Large head movement tracking using scale invariant view-based appearance model

ACIVS'07 Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems
Head pose estimation and augmented reality tracking: an integrated system and evaluation for monitoring driver awareness

IEEE Transactions on Intelligent Transportation Systems
3D head pose estimation and tracking using particle filtering and ICP algorithm

AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Memory-based particle filter for tracking objects with large variation in pose and appearance

ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Learning 3D appearance models from video

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Robust: real-time 3D face tracking from a monocular view

Journal on Image and Video Processing
Model free head pose estimation using stereovision

Pattern Recognition
A mixed reality system for virtual glasses try-on

Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Real-time modeling of face deformation for 3d head pose estimation

AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
Probabilistic inference of gaze patterns and structure of multiparty conversations from head directions and utterances

JSAI'05 Proceedings of the 2005 international conference on New Frontiers in Artificial Intelligence
Linear programming matching and appearance-adaptive object tracking

EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Video analysis of approach-avoidance behaviors of teenagers speaking with virtual agents

Proceedings of the 15th ACM on International conference on multimodal interaction
Evaluation of vision-based real-time measures for emotions discrimination under uncontrolled conditions

Proceedings of the 2013 on Emotion recognition in the wild challenge and workshop
Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a method for online rigid object tracking using an adaptive view-based appearance model. When the object's pose trajectory crosses itself, our tracker has bounded drift and can track objects undergoing large motion for long periods of time. Our tracker registers each incoming frame against the views of the appearance model using a twoframe registration algorithm. Using a linear Gaussian filter, we simultaneously estimate the pose of the object and adjust the view-based model as pose-changes are recovered from the registration algorithm. The adaptive view-based model is populated online with views of the object as it undergoes different orientations in pose space, allowing us to capture non-Lambertian effects. We tested our approach on a real-time rigid object tracking task using stereo cameras and observed an RMS error within the accuracy limit of an attached inertial sensor.