Controlling virtual cameras based on a robust model-free pose acquisition technique

Authors:
Ying Kin Yu;Kin Hong Wong;Siu Hang Or;Chen Junzhou
Affiliations:
Computer Science and Engineering Department, The Chinese University of Hong Kong, Shatin, Hong Kong;Computer Science and Engineering Department, The Chinese University of Hong Kong, Shatin, Hong Kong;Computer Science and Engineering Department, The Chinese University of Hong Kong, Shatin, Hong Kong;Computer Science and Engineering Department, The Chinese University of Hong Kong, Shatin, Hong Kong
Venue:
IEEE Transactions on Multimedia
Year:
2009

Citing 18
Cited 1

Exploration and virtual camera control in virtual three dimensional environments

I3D '90 Proceedings of the 1990 symposium on Interactive 3D graphics
Fitting Parameterized Three-Dimensional Models to Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Threading Fundamental Matrices

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiple view geometry in computer vision

Multiple view geometry in computer vision
A Mathematical Introduction to Robotic Manipulation

A Mathematical Introduction to Robotic Manipulation
Analysis of Head Pose Accuracy in Augmented Reality

IEEE Transactions on Visualization and Computer Graphics
Optimal Motion and Structure Estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recursive Estimation of Motion, Structure, and Focal Length

IEEE Transactions on Pattern Analysis and Machine Intelligence
Structure from Motion Causally Integrated Over Time

IEEE Transactions on Pattern Analysis and Machine Intelligence
Simultaneous Localization and Map-Building Using Active Vision

IEEE Transactions on Pattern Analysis and Machine Intelligence
Motion Estimation on the Essential Manifold

ECCV '94 Proceedings of the Third European Conference-Volume II on Computer Vision - Volume II
A Stereoscopic Video See-Through Augmented Reality System Based on Real-Time Vision-Based Registration

VR '00 Proceedings of the IEEE Virtual Reality 2000 Conference
Recursive Recovery of Position and Orientation from Stereo Image Sequences without Three-Dimensional Structures

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Merging artificial objects with marker-less video sequences based on the interacting multiple model method

IEEE Transactions on Multimedia
Recursive three-dimensional model reconstruction based on Kalman filtering

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Pose estimation for augmented reality applications using genetic algorithm

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Recursive Camera-Motion Estimation With the Trifocal Tensor

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

A hand-held 3D display system that facilitates direct manipulation of 3D virtual objects

Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents a novel method that acquires camera position and orientation from a stereo image sequence without prior knowledge of the scene. To make the algorithm robust, the Interacting Multiple Model Probabilistic Data Association Filter (IMMPDAF) is introduced. The Interacting Multiple Model (IMM) technique allows the existence of more than one dynamic system in the filtering process and in return leads to improved accuracy and stability even under abrupt motion changes. The Probabilistic Data Association (PDA) framework makes the automatic selection of measurement sets possible, resulting in enhanced robustness to occlusions and moving objects. In addition to the IMMPDAF, the trifocal tensor is employed in the computation so that the step of reconstructing the 3-D models can be eliminated. This further guarantees the precision of estimation and computation efficiency. Real stereo image sequences have been used to test the proposed method in the experiment. The recovered 3-D motions are accurate in comparison with the ground truth data and have been applied to control cameras in a virtual environment.