Large head movement tracking using sift-based registration

Authors:
Gangqiang Zhao;Ling Chen;Jie Song;Gencai Chen
Affiliations:
Zhejiang University, Hangzhou, China;Zhejiang University, Hangzhou, China & The University of Nottingham, Nottingham, United Kingdon;Zhejiang University, Hangzhou, China;Zhejiang University, Hangzhou, China
Venue:
Proceedings of the 15th international conference on Multimedia
Year:
2007

Citing 6
Cited 5

Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Model-Based Head Pose Tracking With Stereovision

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Recognising Panoramas

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
A Performance Evaluation of Local Descriptors

IEEE Transactions on Pattern Analysis and Machine Intelligence
Head pose estimation using stereo vision for human-robot interaction

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Toward fully automated face pose estimation

IMCE '09 Proceedings of the 1st international workshop on Interactive multimedia for consumer electronics
Short-term audio-visual atoms for generic video concept classification

MM '09 Proceedings of the 17th ACM international conference on Multimedia
KPB-SIFT: a compact local feature descriptor

Proceedings of the international conference on Multimedia
Estimating human body and head orientation change to detect visual attention direction

ACCV'10 Proceedings of the 2010 international conference on Computer vision - Volume Part I
Editors Choice Article: Face pose estimation with automatic 3D model creation in challenging scenarios

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although there exists dozens of vision based 3D head tracking methods, none of them considers the problem of large motion, especially the movement along the Z axis. In this paper we propose a novel tracking method to handle this problem by using Scale Invariant Feature Transform (SIFT) based registration algorithm. Salient SIFT features are first detected and tracked between two images, and then the 3D points corresponding to these features are obtained from a stereo camera. With these 3D points, a registration algorithm in a RANSAC framework is employed to detect the outliers and estimate the head pose. Performance evaluation shows an accurate pose recovery (3° RMS) when the head has large motion, even with movement along the Z axis was about 150 cm.