Depth Video Enhancement for Haptic Interaction Using a Smooth Surface Reconstruction

  • Authors:

  • Seung-Man Kim;Jongeun Cha;Jeha Ryu;Kwan Heng Lee

  • Affiliations:

  • The authors are with the Intelligent Design and Graphics Laboratory, Gwangju Institute of Science and Technology (GIST), Korea. E-mail: sman@gist.ac.kr,;The authors are with the Human-Machine-Computer Interface Laboratory, Gwangju Institute of Science and Technology (GIST), 1 OryongDong, BukGu, Gwangju 500--712, Korea.;The authors are with the Human-Machine-Computer Interface Laboratory, Gwangju Institute of Science and Technology (GIST), 1 OryongDong, BukGu, Gwangju 500--712, Korea.;The authors are with the Intelligent Design and Graphics Laboratory, Gwangju Institute of Science and Technology (GIST), Korea. E-mail: sman@gist.ac.kr,

  • Venue:
  • IEICE - Transactions on Information and Systems
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a depth video enhancement algorithm in order to provide high quality haptic interaction. As the telecommunication technology emerges rapidly, the depth image-based haptic interaction is becoming viable for broadcasting applications. Since a real depth map usually contains discrete and rugged noise, its haptic interaction produces the distorted force feedback. To resolve these problems, we propose a two-step refinement and adaptive sampling algorithm. In the first step, noise is removed by the median-filtering technique in 2D image space. Since not all pixels can be used to reconstruct the 3D mesh due to limited system resources, the filtered map is adaptively sampled based on the depth variation. Sampled 2D pixels, called feature points, are triangulated and projected onto 3D space. In the second refinement step, we apply the Gaussian smoothing technique to the reconstructed 3D surface. Finally, 3D surfaces are rendered to compute a smooth depth map from Z-buffer.