Appearance based object modeling using texture database: acquisition, compression and rendering

Authors:
R. Furukawa;H. Kawasaki;K. Ikeuchi;M. Sakauchi
Affiliations:
Hiroshima City University, Hiroshima, Japan;The University of Tokyo, Tokyo, Japan;The University of Tokyo, Tokyo, Japan;The University of Tokyo, Tokyo, Japan
Venue:
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Year:
2002

Citing 9
Cited 25

Least-Squares Fitting of Two 3-D Point Sets

IEEE Transactions on Pattern Analysis and Machine Intelligence
Generating octree models of 3D objects from their silhouettes in a sequence of images

Computer Vision, Graphics, and Image Processing
Rapid octree construction from image sequences

CVGIP: Image Understanding
Sensor Modeling, Probabilistic Hypothesis Generation, and Robust Localization for Object Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Reflectance and texture of real-world surfaces

ACM Transactions on Graphics (TOG)
Surface light fields for 3D photography

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Eigen-Texture Method: Appearance Compression and Synthesis Based on a 3D Model

IEEE Transactions on Pattern Analysis and Machine Intelligence

Image-based reconstruction of spatial appearance and geometric detail

ACM Transactions on Graphics (TOG)
Measuring bidirectional texture reflectance with a kaleidoscope

ACM SIGGRAPH 2003 Papers
Nonlinear optimization framework for image-based modeling on programmable graphics hardware

ACM SIGGRAPH 2003 Papers
Decoupling BRDFs from surface mesostructures

GI '04 Proceedings of the 2004 Graphics Interface Conference
TensorTextures: multilinear image-based rendering

ACM SIGGRAPH 2004 Papers
Rendering Deformable Surface Reflectance Fields

IEEE Transactions on Visualization and Computer Graphics
Out-of-core tensor approximation of multi-dimensional matrices of visual data

ACM SIGGRAPH 2005 Papers
Inverse shade trees for non-parametric material representation and editing

ACM SIGGRAPH 2006 Papers
Nonlinear optimization framework for image-based modeling on programmable graphics hardware

SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Hierarchical Tensor Approximation of Multi-Dimensional Visual Data

IEEE Transactions on Visualization and Computer Graphics
Principles of Appearance Acquisition and Representation

Foundations and Trends® in Computer Graphics and Vision
Wavelet-Texture Method: Appearance Compression by Polarization, Parametric Reflection Model, and Daubechies Wavelet

International Journal of Computer Vision
Building volumetric appearance models of fabric using micro CT imaging

ACM SIGGRAPH 2011 papers
Advanced textural representation of materials appearance

SIGGRAPH Asia 2011 Courses
Data Driven Surface Reflectance from Sparse and Irregular Samples

Computer Graphics Forum
Higher-order SVD analysis for crowd density estimation

Computer Vision and Image Understanding
BTF compression via sparse tensor decomposition

EGSR'09 Proceedings of the Twentieth Eurographics conference on Rendering
Efficient basis decomposition for scattered reflectance data

EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Rapid synchronous acquisition of geometry and appearance of cultural heritage artefacts

VAST'05 Proceedings of the 6th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage
Integrated high-quality acquisition of geometry and appearance for cultural heritage

VAST'11 Proceedings of the 12th International conference on Virtual Reality, Archaeology and Cultural Heritage
WebGL-based streaming and presentation framework for bidirectional texture functions

VAST'11 Proceedings of the 12th International conference on Virtual Reality, Archaeology and Cultural Heritage
WebGL-based streaming and presentation of objects with bidirectional texture functions

Journal on Computing and Cultural Heritage (JOCCH)
Technical Section: Interactive high fidelity visualization of complex materials on the GPU

Computers and Graphics
Texture databases - A comprehensive survey

Pattern Recognition Letters
Low-rank separated representation surrogates of high-dimensional stochastic functions: Application in Bayesian inference

Journal of Computational Physics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Image-based object modeling can be used to compose photorealistic images of modeled objects for various rendering conditions, such as viewpoint, light directions, etc. However, it is challenging to acquire the large number of object images required for all combinations of capturing parameters and to then handle the resulting huge data sets for the model. This paper presents a novel modeling method for acquiring and preserving appearances of objects. Using a specialized capturing platform, we first acquire objects' geometrical information and their complete 4D indexed texture sets, or bi-directional texture functions (BTF) in a highly automated manner. Then we compress the acquired texture database using tensor product expansion. The compressed texture database facilitates rendering objects with arbitrary viewpoints, illumination, and deformation.