Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm

  • Authors:
  • Songkran Jarusirisawad;Vincent Nozick;Hideo Saito

  • Affiliations:
  • Department of Information and Computer Science, Keio University 3-14-1 Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan;Institut Gaspard Monge, Université Paris-Est Marne-la-Vallée, Cité DESCARTES, 5 Boulevard Descartes, 77454 Marne-la-Vallée Cedex 2, France;Department of Information and Computer Science, Keio University 3-14-1 Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan

  • Venue:
  • Journal of Visual Communication and Image Representation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a new online video-based rendering (VBR) method that creates new views of a scene from uncalibrated cameras. Our method does not require information about the cameras intrinsic parameters. For obtaining a geometrical relation among the cameras, we use projective grid space (PGS) which is 3D space defined by epipolar geometry between two basis cameras. The other cameras are registered to the same 3D space by trifocal tensors between these basis cameras. We simultaneously reconstruct and render novel view using our proposed plane-sweep algorithm in PGS. To achieve real-time performance, we implemented the proposed algorithm in graphics processing unit (GPU). We succeed to create novel view images in real-time from uncalibrated cameras and the results show the efficiency of our proposed method.