Fast 3d structure from motion with missing points from registration of partial reconstructions

Authors:
Nader Mahmoud;Stephane A. Nicolau;Arabi Keshk;Mostafa A. Ahmad;Luc Soler;Jacques Marescaux
Affiliations:
IRCAD (Institut de Recherche contre les Cancers de l'Appareil Digestif), France, Department of Computer Science, Faculty of Computers and Information, Menofia University, Egypt;IRCAD (Institut de Recherche contre les Cancers de l'Appareil Digestif), France;Department of Computer Science, Faculty of Computers and Information, Menofia University, Egypt;Department of Computer Science, Faculty of Computers and Information, Menofia University, Egypt;IRCAD (Institut de Recherche contre les Cancers de l'Appareil Digestif), France;IRCAD (Institut de Recherche contre les Cancers de l'Appareil Digestif), France
Venue:
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Year:
2012

Citing 7
Cited 0

Least-Squares Fitting of Two 3-D Point Sets

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
Euclidean Shape and Motion from Multiple Perspective Views by Affine Iterations

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Paraperspective Factorization Method for Shape and Motion Recovery

IEEE Transactions on Pattern Analysis and Machine Intelligence
Linear Fitting with Missing Data: Applications to Structure-from-Motion and to Characterizing Intensity Images

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Online/Realtime Structure and Motion for General Camera Models

WACV '08 Proceedings of the 2008 IEEE Workshop on Applications of Computer Vision
Generic and real-time structure from motion using local bundle adjustment

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Structure From Motion (SFM) technique is usually used for camera motion recovery and 3D shape estimation. But the major problem with SFM is the occlusion of feature points which lead to hallucinate them, and thus increase the computation time. In this paper, we propose a method for a 3D shape reconstruction from a video sequence based on registering multiple partial reconstructions (patches). The proposed method avoids relying on hallucination step, which means a reduction of computation time. A realistic 3D textured shape is provided using a texture mapping pipeline based on the recovered motion of the camera. Experimental results on both synthetic and real images show that the proposed method is more than 200 times (on average) faster than the classical SFM methods which need to hallucinate the occluded points.