Novel 3D model reconstruction method for the co-existence of diffuse and specular object surfaces

Authors:
H. Y. Ip;K. L. Chan
Affiliations:
Department of Electronic Engineering, City University of Hong Kong, Kowloon, Hong Kong;Department of Electronic Engineering, City University of Hong Kong, Kowloon, Hong Kong
Venue:
SPPR'07 Proceedings of the Fourth conference on IASTED International Conference: Signal Processing, Pattern Recognition, and Applications
Year:
2007

Citing 11
Cited 0

Marching cubes: A high resolution 3D surface construction algorithm

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
A Theory of Specular Surface Geometry

International Journal of Computer Vision
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Photorealistic Scene Reconstruction by Voxel Coloring

International Journal of Computer Vision
Epipolar Geometry from Profiles under Circular Motion

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Theory of Shape by Space Carving

International Journal of Computer Vision - Special issue on Genomic Signal Processing
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multi Viewpoint Stereo from Uncalibrated Video Sequences

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Multi-View 3D Model Reconstruction: Exploitation of Color Homogeneity in Voxel Mask

ICIG '04 Proceedings of the Third International Conference on Image and Graphics
Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs

IEEE Transactions on Pattern Analysis and Machine Intelligence
Volumetric Model Reconstruction from Unrestricted Camera Views Based on the Photo-consistency of 3D Voxel Mask

Machine Vision and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This project aims to develop a system that can reconstruct photorealistic 3D model of object automatically from a multi-view image sequence. The whole system consists of four major steps: camera calibration, volumetric modeling, surface model formation and texture mapping. A conservative volumetric object model is first reconstructed based on the shape-from-silhouette approach. Conventional volumetric modeling algorithms for refining the model assume that the object surface is Lambertian but many real objects exhibit both diffuse and specular reflections of illuminated light. We propose a novel volumetric modeling algorithm that can handle the co-existence of both diffuse and specular surfaces. Our algorithm also differs from others that the model is reconstructed by aggregating evidence in the voxel space via the use of voxel mask. We select some real objects for modeling and compare our volumetric modeling algorithm with the well-known Space Carving Algorithm. Reconstructed object models are presented, together with the model reprojection accuracy, to demonstrate the superior performance of the new 3D model reconstruction scheme.