Spatial and temporal up-conversion technique for depth video

  • Authors:

  • Jinwook Choi;Dongbo Min;Bumsub Ham;Kwanghoon Sohn

  • Affiliations:

  • Dept. of Electrical and Electronic Eng., Yonsei University, Seoul, Korea;Dept. of Electrical and Electronic Eng., Yonsei University, Seoul, Korea;Dept. of Electrical and Electronic Eng., Yonsei University, Seoul, Korea;Dept. of Electrical and Electronic Eng., Yonsei University, Seoul, Korea

  • Venue:
  • ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a novel framework for up-conversion of depth video resolution both in spatial and in time domain. Time-of-Flight (TOF) sensors are widely used in computer vision fields. Although TOF sensors provide depth video in real time, there are some problems in a sense that it provides a low resolution and a low frame-rate depth video. We propose a cheaper solution that enhances depth video obtained by TOF sensor by combining it with CCD camera. The proposed method provides high quality video as a cheaper solution for low resolution, and low frame-rate depth video. It is useful when depth video is used in various applications such as 3DTV, freeview TV, teleconference system. High-quality depth video can be obtained by motion compensated frame interpolation (MCFI) and extended Joint Bilateral Upsampling (JBU). Experimental results show that depth video obtained by the proposed method has satisfactory quality.