Photorealistic rendering for augmented reality using environment illumination

  • Authors:
  • Kusuma Agusanto;Li Li;Zhu Chuangui;Ng Wan Sing

  • Affiliations:
  • -;-;-;-

  • Venue:
  • ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Mixing 3D computer-generated images with real-sceneimages seamlessly in augmented reality has many desirableand wide areas of applications such as entertainment,cinematography, design visualization and medical trainings.The challenging task is to make virtual objects blendharmoniously into the real scene and appear as if theyare like real. Apart from constructing detailed geometric3D model representation and obtaining accurate surfaceproperties for virtual objects, adopting real scene lightinginformation to render virtual objects is anotherimportant factor to achieve photorealistic rendering.Such a factor not only improves visual complexity of virtualobjects, but also determines the consistency ofillumination between the virtual objects and the surroundingreal objects in the scene. Conventional renderingtechniques such as ray tracing, and radiosity requireintensive computation and data preparation to solve thelighting transport equation. Hence, they are less practicalfor rendering virtual objects in augmented reality, whichdemands a real-time performance. This work explores animage-based and hardware-based approach to improvephotorealism for rendering synthetic objects in augmentedreality. It uses a recent technique of image-based lighting,environment illumination maps, and a simple yet practicalmulti-pass rendering framework for augmented reality.