Interactive viewpoint control and three-dimensional operations
I3D '92 Proceedings of the 1992 symposium on Interactive 3D graphics
CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
The virtual workbench: dextrous VR
VRST '94 Proceedings of the conference on Virtual reality software and technology
Physical versus virtual pointing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
The ImmersaDesk and Infinity Wall projection-based virtual reality displays
ACM SIGGRAPH Computer Graphics
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Designing cranial implants in a haptic augmented reality environment
Communications of the ACM - Interactive immersion in 3D graphics
Visual touchpad: a two-handed gestural input device
Proceedings of the 6th international conference on Multimodal interfaces
Spatial Augmented Reality: Merging Real and Virtual Worlds
Spatial Augmented Reality: Merging Real and Virtual Worlds
ASTOR: An Autostereoscopic Optical See-through Augmented Reality System
ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
A 2D–3D integrated tabletop environment for multi-user collaboration: Research Articles
Computer Animation and Virtual Worlds
Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Extended Virtual Table: An Optical Extension for Table-Like Projection Systems
Presence: Teleoperators and Virtual Environments
A survey of mobile and wireless technologies for augmented reality systems
Computer Animation and Virtual Worlds
Bringing physics to the surface
Proceedings of the 21st annual ACM symposium on User interface software and technology
Going beyond the display: a surface technology with an electronically switchable diffuser
Proceedings of the 21st annual ACM symposium on User interface software and technology
A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach
International Journal of Computer Vision
Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking
ISWC '07 Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers
Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR
ISMAR '08 Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality
A screen-space formulation for 2D and 3D direct manipulation
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Interactions in the air: adding further depth to interactive tabletops
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Simulating grasping behavior on an imaging interactive surface
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
pCubee: a perspective-corrected handheld cubic display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
RePro3D: full-parallax 3D display using retro-reflective projection technology
ACM SIGGRAPH 2010 Emerging Technologies
Combining multiple depth cameras and projectors for interactions on, above and between surfaces
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
The design and evaluation of 3D positioning techniques for multi-touch displays
3DUI '10 Proceedings of the 2010 IEEE Symposium on 3D User Interfaces
Dropping the ball: Releasing a virtual grasp
3DUI '11 Proceedings of the 2011 IEEE Symposium on 3D User Interfaces
Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance
3DUI '11 Proceedings of the 2011 IEEE Symposium on 3D User Interfaces
DRIVE: Directly Reaching Into Virtual Environment with bare hand manipulation behind mobile display
3DUI '11 Proceedings of the 2011 IEEE Symposium on 3D User Interfaces
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Proceedings of the 24th annual ACM symposium on User interface software and technology
Vermeer: direct interaction with a 360° viewable 3D display
Proceedings of the 24th annual ACM symposium on User interface software and technology
Toucheo: multitouch and stereo combined in a seamless workspace
Proceedings of the 24th annual ACM symposium on User interface software and technology
MirageTable: freehand interaction on a projected augmented reality tabletop
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Virtual grasp release method and evaluation
International Journal of Human-Computer Studies
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Proceedings of the 25th annual ACM symposium on User interface software and technology
Is stereoscopic 3D a better choice for information representation in the car?
Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Binocular cursor: enabling selection on transparent displays troubled by binocular parallax
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Trigger shift: participatory design of an augmented theatrical performance with young people
Proceedings of the 9th ACM Conference on Creativity & Cognition
User-defined gestures for augmented reality
CHI '13 Extended Abstracts on Human Factors in Computing Systems
BeThere: 3D mobile collaboration with spatial input
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SpaceTop: integrating 2D and spatial 3D interactions in a see-through desktop environment
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Flexpad: highly flexible bending interactions for projected handheld displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Improving digital handoff using the space above the table
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Direct 3D object manipulation on a collaborative stereoscopic display
Proceedings of the 1st symposium on Spatial user interaction
Visualization of off-surface 3D viewpoint locations in spatial augmented reality
Proceedings of the 1st symposium on Spatial user interaction
Dynamics based 3D skeletal hand tracking
Proceedings of Graphics Interface 2013
Using eye-tracking to support interaction with layered 3D interfaces on stereoscopic displays
Proceedings of the 19th international conference on Intelligent User Interfaces
Hi-index | 0.01 |
HoloDesk is an interactive system combining an optical see through display and Kinect camera to create the illusion that users are directly interacting with 3D graphics. A virtual image of a 3D scene is rendered through a half silvered mirror and spatially aligned with the real-world for the viewer. Users easily reach into an interaction volume displaying the virtual image. This allows the user to literally get their hands into the virtual display and to directly interact with an spatially aligned 3D virtual world, without the need for any specialized head-worn hardware or input device. We introduce a new technique for interpreting raw Kinect data to approximate and track rigid (e.g., books, cups) and non-rigid (e.g., hands, paper) physical objects and support a variety of physics-inspired interactions between virtual and real. In particular the algorithm models natural human grasping of virtual objects with more fidelity than previously demonstrated. A qualitative study highlights rich emergent 3D interactions, using hands and real-world objects. The implementation of HoloDesk is described in full, and example application scenarios explored. Finally, HoloDesk is quantitatively evaluated in a 3D target acquisition task, comparing the system with indirect and glasses-based variants.