Registration of 3D geometric model and color images using SIFT and range intensity images

Authors:
Ryo Inomata;Kenji Terabayashi;Kazunori Umeda;Guy Godin
Affiliations:
Chuo University, Tokyo, Japan;Chuo University, Tokyo, Japan;Chuo University, Tokyo, Japan;National Research Council, Ottawa, Ontario, Canada
Venue:
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Year:
2011

Citing 8
Cited 0

Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps

IEEE Transactions on Pattern Analysis and Machine Intelligence
The digital Michelangelo project: 3D scanning of large statues

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Automated Texture Registration and Stitching for Real World Models

PG '00 Proceedings of the 8th Pacific Conference on Computer Graphics and Applications
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Registration of Range and Color Images Using Gradient Constraints and Range Intensity Images

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Correction of color information of a 3D model using a range intensity image

Computer Vision and Image Understanding

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new method for 3D-2D registration based on SIFT and a range intensity image, which is a kind of intensity image simultaneously acquired with a range image using an active range sensor. A linear equation for the registration parameters is formulated, which is combined with displacement estimations for extrinsic and intrinsic parameters and the distortion of a camera's lens. This equation is solved to match a range intensity image and a color image using SIFT. The range intensity and color images differ, and the pairs of matched feature points usually contain a number of false matches. To reduce false matches, a range intensity image is combined with the background image of a color image. Then, a range intensity image is corrected for extracting good candidates. Moreover, to remove false matches while keeping correct matches, soft matching, in which false matches are weakly removed, is used. First, false matches are removed by using scale information from SIFT. Secondly, matching reliability is defined from the Bhattacharyya distance of the pair of matched feature points. Then RANSAC is applied. In this stage, its threshold is kept high. In our approach, the accuracy of registration is advanced. The effectiveness of the proposed method is illustrated by experiments with real-world objects.