On-site real-time 3D match move for MR-based previsualization with relighting

  • Authors:
  • Ryosuke Ichikari;Kaori Kikuchi;Wataru Toishita;Ryuhei Tenmoku;Fumihisa Shibata;Hideyuki Tamura

  • Affiliations:
  • Ritsumeikan University;Ritsumeikan University;Ritsumeikan University;Ritsumeikan University;Ritsumeikan University;Ritsumeikan University

  • Venue:
  • ACM SIGGRAPH 2010 Talks
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We are developing a previsualization method called MR-PreViz, which utilizes mixed reality technology for filmmaking [Tenmoku et al. 2006]. To determine camera-work at the shooting site, estimating camera position and posture is required. In this paper, we introduce a method for on-site real-time 3D match move and relighting for MR-PreViz. To realize the match move, we developed a computer vision-based camera tracking method using natural feature tracking. This method is based on details about the site captured in advance. The method can automatically construct a feature landmark database (LMDB) using a fiducial marker. Moreover, the result of the method enables MR-PreViz to design lighting for the site using a relighting method. To add lighting effects to the real objects, the relighting method uses reflectance properties of the real objects and LMDB.