Handling occlusions for robust augmented reality systems

Authors:
Madjid Maidi;Fakhreddine Ababsa;Malik Mallem
Affiliations:
IBISC Laboratory, CNRS, University of Evry Val d'Essonne, Evry Cedex, France;IBISC Laboratory, CNRS, University of Evry Val d'Essonne, Evry Cedex, France;IBISC Laboratory, CNRS, University of Evry Val d'Essonne, Evry Cedex, France
Venue:
Journal on Image and Video Processing - Special issue on fast and robust methods for multiple-view vision
Year:
2010

Citing 14
Cited 1

Robust model-based motion tracking through the integration of search and estimation

International Journal of Computer Vision
Tracking with rigid models

Active vision
A fast and robust line-based optical tracker for augmented reality applications

IWAR '98 Proceedings of the international workshop on Augmented reality : placing artificial objects in real scenes: placing artificial objects in real scenes
CyberCode: designing augmented reality environments with visual tags

DARE '00 Proceedings of DARE 2000 on Designing augmented reality environments
Hybrid Inertial and Vision Tracking for Augmented Reality Registration

VR '99 Proceedings of the IEEE Virtual Reality
Multi-Ring Color Fiducial Systems for Scalable Fiducial Tracking Augmented Reality

VRAIS '98 Proceedings of the Virtual Reality Annual International Symposium
Circular Data Matrix Fiducial System and Robust Image Processing for a Wearable Vision-Inertial Self-Tracker

ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
An Introduction to the Kalman Filter

An Introduction to the Kalman Filter
A real-time tracker for markerless augmented reality

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
ARTag, a Fiducial Marker System Using Digital Techniques

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Encoded LED System for Optical Trackers

ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
Precise Geometric Registration by Blur Estimation for Vision-based Augmented Reality

ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Fast algorithm for robust template matching with M-estimators

IEEE Transactions on Signal Processing

A new marker design for a robust marker tracking system against occlusions

Computer Animation and Virtual Worlds

Quantified Score

Hi-index	0.00

Visualization

Abstract

In Augmented Reality applications, the human perception is enhanced with computer-generated graphics. These graphics must be exactly registered to real objects in the scene and this requires an effective Augmented Reality system to track the user's viewpoint. In this paper, a robust tracking algorithm based on coded fiducials is presented. Square targets are identified and pose parameters are computed using a hybrid approach based on a direct method combined with the Kalman filter. An important factor for providing a robust Augmented Reality system is the correct handling of targets occlusions by real scene elements. To overcome tracking failure due to occlusions, we extend our method using an optical flow approach to track visible points and maintain virtual graphics overlaying when targets are not identified. Our proposed real-time algorithm is tested with different camera viewpoints under various image conditions and shows to be accurate and robust.