8D: interacting with a relightable glasses-free 3D display

Authors:
Matthew Hirsch;Shahram Izadi;Henry Holtzman;Ramesh Raskar
Affiliations:
Massachusetts Institute of Technology, Cambridge, USA;Microsoft Research, Cambridge, USA;Massachusetts Institute of Technology, Cambridge, USA;Massachusetts Institute of Technology, Cambridge, USA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2013

Citing 14
Cited 1

Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Lighting sensitive display

ACM Transactions on Graphics (TOG)
Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing

ACM SIGGRAPH 2007 papers
Light field transfer: global illumination between real and synthetic objects

ACM SIGGRAPH 2008 papers
Towards passive 6D reflectance field displays

ACM SIGGRAPH 2008 papers
Going beyond the display: a surface technology with an electronically switchable diffuser

Proceedings of the 21st annual ACM symposium on User interface software and technology
Flux: a tilting multi-touch and pen based surface

CHI '09 Extended Abstracts on Human Factors in Computing Systems
BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields

ACM SIGGRAPH Asia 2009 papers
PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Build your own glasses-free 3D display

ACM SIGGRAPH 2011 Courses
deForm: an interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch

Proceedings of the 24th annual ACM symposium on User interface software and technology
Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting

ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Interactive light field painting

ACM SIGGRAPH 2012 Emerging Technologies
Antialiasing for automultiscopic 3D displays

EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques

Special Section on Advanced Displays: A survey on computational displays: Pushing the boundaries of optics, computation, and perception

Computers and Graphics

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present an 8-dimensional (8D) display that allows glasses-free viewing of 3D imagery, whist capturing and reacting to incident environmental and user controlled light sources. We demonstrate two interactive possibilities enabled by our lens-array-based hardware prototype, and realtime GPU-accelerated software pipeline. Additionally, we describe a path to deploying such displays in the future, using current Sensor-in-Pixel (SIP) LCD panels, which physically collocate sensing and display elements.