Arbitrary viewpoint image synthesis for real-time processing system using multiple image sensors

Authors:
Hiroki Sato;Sho Ogura;Tadaaki Hosaka;Takayuki Hamamoto;Akira Kubota;Ryutaro Oi;Kazuya Kodama
Affiliations:
Tokyo University of Science;Tokyo University of Science;Tokyo University of Science;Tokyo University of Science;Chuo University;NICT;NII
Venue:
Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry
Year:
2009

Citing 3
Cited 0

Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
High-quality video view interpolation using a layered representation

ACM SIGGRAPH 2004 Papers

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have studied arbitrary viewpoint image synthesis using multiple sensors based on image-based rendering, in which the depth estimation is required for generating precise virtual images. Major problems in this estimation process include the increase of computational efforts and the decrease in performance for occluded regions. To solve these difficulties, we improve our depth estimation process by using the multi-resolution method and by weighting similar pixels to the target pixel in the block matching. Furthermore, we incorporate the proposed method to our prototype hardware system using the CMOS image sensors we have originally developed. Experimental results show that our proposed method and prototype system are efficient and effective compared to the previous work and that arbitrary viewpoint images are synthesized favorably.