Gaze Manipulation for One-to-one Teleconferencing

  • Authors:
  • A. Criminisi;J. Shotton;A. Blake;P. H. S. Torr

  • Affiliations:
  • -;-;-;-

  • Venue:
  • ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new algorithm is proposed for novel view generation in one-to-oneteleconferencing applications. Given the video streams acquired bytwo cameras placed on either side of a computer monitor, theproposed algorithm synthesises images from a virtual camera inarbitrary position (typically located within the monitor) tofacilitate eye contact. Our technique is based on an improved,dynamic-programming, stereo algorithm for efficient novel-viewgeneration. The two main contributions of this paper are: i) a newtype of three-plane graph for dense-stereo dynamic-programming,that encourages correct occlusion labeling; ii) a compact geometricderivation for novel-view synthesis by direct projection of theminimum-cost surface. Furthermore, this paper presents a novelalgorithm for the temporal maintenance of a background model toenhance the rendering of occlusions and reduce temporal artefacts(flicker); and a cost aggregation algorithm that acts directly onour three-dimensional matching cost space. Examples are given thatdemonstrate the robustness of the new algorithm to spatial andtemporal artefacts for long stereo video streams. These includedemonstrations of synthesis of cyclopean views of extendedconversational sequences. We further demonstrate synthesis from afreely translating virtual camera.