Spatio-temporal Super-Resolution Using Depth Map

  • Authors:
  • Yusaku Awatsu;Norihiko Kawai;Tomokazu Sato;Naokazu Yokoya

  • Affiliations:
  • Graduate School of Information Science, Nara Institute of Science and Technology, Nara, Japan 630-0192;Graduate School of Information Science, Nara Institute of Science and Technology, Nara, Japan 630-0192;Graduate School of Information Science, Nara Institute of Science and Technology, Nara, Japan 630-0192;Graduate School of Information Science, Nara Institute of Science and Technology, Nara, Japan 630-0192

  • Venue:
  • SCIA '09 Proceedings of the 16th Scandinavian Conference on Image Analysis
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a spatio-temporal super-resolution method using depth maps for static scenes. In the proposed method, the depth maps are used as the parameters to determine the corresponding pixels in multiple input images by assuming that intrinsic and extrinsic camera parameters are known. Because the proposed method can determine the corresponding pixels in multiple images by a one-dimensional search for the depth values without the planar assumption that is often used in the literature, spatial resolution can be increased even for complex scenes. In addition, since we can use multiple frames, temporal resolution can be increased even when large parts of the image are occluded in the adjacent frame. In experiments, the validity of the proposed method is demonstrated by generating spatio-temporal super-resolution images for both synthetic and real movies.