Shape recognition and pose estimation for mobile augmented reality

Authors:
Nate Hagbi;Oriel Bergig;Jihad El-Sana;Mark Billinghurst
Affiliations:
The Visual Media Lab, Ben-Gurion University, Israel;The Visual Media Lab, Ben-Gurion University, Israel;The Visual Media Lab, Ben-Gurion University, Israel;The HIT Lab NZ, University of Canterbury, New Zealand
Venue:
ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality
Year:
2009

Citing 0
Cited 8

Multimodal interaction concepts for mobile augmented reality applications

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
Estimating scale using depth from focus for mobile augmented reality

Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems
Utilizing sensor fusion in markerless mobile augmented reality

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
Novel Applications of VR: Efficient mobile AR technology using scalable recognition and tracking based on server-client model

Computers and Graphics
Augmented Reality: Handheld Augmented Reality involving gravity measurements

Computers and Graphics
Spatial augmented reality to enhance physical artistic creation

Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
Experiencing real 3D gestural interaction with mobile devices

Pattern Recognition Letters
Tracking-based interaction for object creation in mobile augmented reality

Proceedings of the 21st ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present Nestor, a system for real-time recognition and camera pose estimation from planar shapes. The system allows shapes that carry contextual meanings for humans to be used as Augmented Reality (AR) tracking fiducials. The user can teach the system new shapes at runtime by showing them to the camera. The learned shapes are then maintained by the system in a shape library. Nestor performs shape recognition by analyzing contour structures and generating projective invariant signatures from their concavities. The concavities are further used to extract features for pose estimation and tracking. Pose refinement is carried out by minimizing the reprojection error between sample points on each image contour and its library counterpart. Sample points are matched by evolving an active contour in real time. Our experiments show that the system provides stable and accurate registration, and runs at interactive frame rates on a Nokia N95 mobile phone.