Image-based relighting: representation and compression

  • Authors:
  • Tien-Tsin Wong;Pheng-Ann Heng

  • Affiliations:
  • Department of Computer Science & Engineering, The Chinese University of Hong Kong, Hong Kong;Department of Computer Science & Engineering, The Chinese University of Hong Kong, Hong Kong

  • Venue:
  • Integrated image and graphics technologies
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Image-based modeling and rendering has been demonstrated as a cost-effective and efficient approach to computer games and virtual reality applications. The computational model that most image-based techniques are based on is the plenoptic function. Since the original formulation of the plenoptic function does not include illumination, previous image-based applications simply assume that the illumination is fixed. We have proposed a new formulation of the plenoptic function, called the plenoptic illumination function, which explicitly specifies the illumination component. Techniques based on this formulation can be extended to support relighting as well as view interpolation. The core of this framework is compression, and we show how to exploit three types of data correlation, the intra-pixel, the inter-pixel and the inter-channel correlations, in order to achieve a manageable storage size. The proposed coding method outperforms JPEG, JPEG2000 and MPEG.