PCA-based compression for image-based relighting

  • Authors:
  • Pun-Mo Ho;Tien-Tsin Wong;Kwok-Hung Choy

  • Affiliations:
  • Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong, China;Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong, China;Pervasive Media Manage. Group, IBM Thomas J. Watson Res. Center, Hawthorne, NY, USA

  • Venue:
  • ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The ability to change illumination is a crucial factor in image-based modeling and rendering. Image-based relighting offers such capability. However, the trade-off is the enormous increase of storage requirement. In this paper, we propose a compression scheme that effectively reduces the data volume while maintaining the real-time relighting capability. The proposed method is based on principal component analysis (PCA). A block-wise PCA is used to practically process the huge input data. The output of PCA is a set of eigenimages and the corresponding relighting coefficients. By dropping those low-energy eigenimages, the data size is drastically reduced. To further compress the data, eigenimages left are compressed using transform coding and quantization while the relighting coefficients are compressed using uniform quantization. We also suggest the suitable target bit rate for each phase of the compression method in order to preserve the visual quality. Finally, we propose real-time engine that relights images from the compressed data.