SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
HoloWall: designing a finger, hand, body, and object sensitive wall
Proceedings of the 10th annual ACM symposium on User interface software and technology
Range estimation by optical differentiation
Range estimation by optical differentiation
Rational Filters for Passive Depth from Defocus
International Journal of Computer Vision
A multi-touch three dimensional touch-sensitive tablet
CHI '85 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DiamondTouch: a multi-user touch technology
Proceedings of the 14th annual ACM symposium on User interface software and technology
SmartSkin: an infrastructure for freehand manipulation on interactive surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
IEEE Transactions on Pattern Analysis and Machine Intelligence
ACM Transactions on Graphics (TOG)
TouchLight: an imaging touch screen and display for gesture-based interaction
Proceedings of the 6th international conference on Multimodal interfaces
Visual touchpad: a two-handed gestural input device
Proceedings of the 6th international conference on Multimodal interfaces
ACM SIGGRAPH 2005 Papers
Cross-Dimensional Gestural Interaction Techniques for Hybrid Imrnersive Environments
VR '05 Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality
Low-cost multi-touch sensing through frustrated total internal reflection
Proceedings of the 18th annual ACM symposium on User interface software and technology
DTLens: multi-user tabletop spatial data exploration
Proceedings of the 18th annual ACM symposium on User interface software and technology
Lensless Imaging with a Controllable Aperture
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Image and depth from a conventional camera with a coded aperture
ACM SIGGRAPH 2007 papers
ThinSight: integrated optical multi-touch sensing through thin form-factor displays
EDT '07 Proceedings of the 2007 workshop on Emerging displays technologies: images and beyond: the future of displays and interacton
Programmable aperture photography: multiplexed light field acquisition
ACM SIGGRAPH 2008 papers
Light field transfer: global illumination between real and synthetic objects
ACM SIGGRAPH 2008 papers
Towards passive 6D reflectance field displays
ACM SIGGRAPH 2008 papers
Shield fields: modeling and capturing 3D occluders
ACM SIGGRAPH Asia 2008 papers
Going beyond the display: a surface technology with an electronically switchable diffuser
Proceedings of the 21st annual ACM symposium on User interface software and technology
ACM SIGGRAPH Asia 2010 papers
ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing
Computers in Entertainment (CIE) - Special Issue: Advances in Computer Entertainment Technology
Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces
ACM International Conference on Interactive Tabletops and Surfaces
PTask: operating system abstractions to manage GPUs as compute devices
SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
ThickPad: a hover-tracking touchpad for a laptop
Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
Edge-guided resolution enhancement in projectors via optical pixel sharing
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
MUSTARD: a multi user see through AR display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
8D display: a relightable glasses-free 3D display
ACM SIGGRAPH 2012 Posters
Computational plenoptic imaging
ACM SIGGRAPH 2012 Courses
Finger and hand detection for multi-touch interfaces based on maximally stable extremal regions
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
8D display: a relightable glasses-free 3D display
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
HACHIStack: dual-layer photo touch sensing for haptic and auditory tapping interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
8D: interacting with a relightable glasses-free 3D display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Focused and casual interactions: allowing users to vary their level of engagement
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 1st symposium on Spatial user interaction
Hi-index | 0.01 |
We transform an LCD into a display that supports both 2D multi-touch and unencumbered 3D gestures. Our BiDirectional (BiDi) screen, capable of both image capture and display, is inspired by emerging LCDs that use embedded optical sensors to detect multiple points of contact. Our key contribution is to exploit the spatial light modulation capability of LCDs to allow lensless imaging without interfering with display functionality. We switch between a display mode showing traditional graphics and a capture mode in which the backlight is disabled and the LCD displays a pinhole array or an equivalent tiled-broadband code. A large-format image sensor is placed slightly behind the liquid crystal layer. Together, the image sensor and LCD form a mask-based light field camera, capturing an array of images equivalent to that produced by a camera array spanning the display surface. The recovered multi-view orthographic imagery is used to passively estimate the depth of scene points. Two motivating applications are described: a hybrid touch plus gesture interaction and a light-gun mode for interacting with external light-emitting widgets. We show a working prototype that simulates the image sensor with a camera and diffuser, allowing interaction up to 50 cm in front of a modified 20.1 inch LCD.