8D display: a relightable glasses-free 3D display

  • Authors:

  • Matthew Hirsch;Shahram Izadi;Henry Holtzman;Ramesh Raskar

  • Affiliations:

  • MIT Media Lab, Cambridge, Massachusetts, USA;Microsoft Research Limited, Cambridge, Cambridgeshire, UK;MIT Media Lab, Cambridge, Massachusetts, USA;MIT Media Lab, Cambridge, Cambridge, Cambridge, Massachusetts, USA

  • Venue:
  • Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

magine a display that behaves like a window. Glancing through it, viewers perceive a virtual 3D scene with correct parallax, without the need to wear glasses or track the user. Light that passes through the display correctly illuminates the virtual scene. While researchers have considered such displays, or prototyped subsets of these capabilities, we contribute a new, interactive, relightable, glasses-free 3D display. By simultaneously capturing a 4D light field, and displaying a 4D light field, we are able to realistically modulate the incident light on rendered content. We present our optical design, and GPU pipeline. Beyond mimicking the physical appearance of objects under natural lighting, an 8D display can create arbitrary directional illumination patterns and record their interaction with physical objects. Our hardware points the way towards novel 3D interfaces, in which users interact with digital content using light widgets, physical objects, and gesture.