Object-oriented video: interaction with real-world objects through live video
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Project FEELEX: adding haptic surface to graphics
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Illuminating clay: a 3-D tangible interface for landscape analysis
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
IEEE Computer Graphics and Applications
4 + 4 fingers manipulating virtual objects in mixed-reality environment
Presence: Teleoperators and Virtual Environments - Mixed reality
Shader Lamps: Animating Real Objects With Image-Based Illumination
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Spatial input/display correspondence in a stereoscopic computer graphic work station
SIGGRAPH '83 Proceedings of the 10th annual conference on Computer graphics and interactive techniques
Designing cranial implants in a haptic augmented reality environment
Communications of the ACM - Interactive immersion in 3D graphics
PHOXEL-SPACE: an interface for exploring volumetric data with physical voxels
DIS '04 Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques
Spatial Augmented Reality: Merging Real and Virtual Worlds
Spatial Augmented Reality: Merging Real and Virtual Worlds
Claytronics: highly scalable communications, sensing, and actuation networks
Proceedings of the 3rd international conference on Embedded networked sensor systems
ASTOR: An Autostereoscopic Optical See-through Augmented Reality System
ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays
Proceedings of the 1st international conference on Tangible and embedded interaction
Proceedings of the 2008 ACM symposium on Virtual reality software and technology
AR-Jig: A Handheld Tangible User Interface for Modification of 3D Digital Form via 2D Physical Curve
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Prototyping digital clay as an active material
Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
ACM SIGGRAPH 2009 Emerging Technologies
Designing Laser Gesture Interface for Robot Control
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
RePro3D: full-parallax 3D display using retro-reflective projection technology
ACM SIGGRAPH 2010 Emerging Technologies
OmniTouch: wearable multitouch interaction everywhere
Proceedings of the 24th annual ACM symposium on User interface software and technology
Direct and gestural interaction with relief: a 2.5D shape display
Proceedings of the 24th annual ACM symposium on User interface software and technology
Vermeer: direct interaction with a 360° viewable 3D display
Proceedings of the 24th annual ACM symposium on User interface software and technology
Toucheo: multitouch and stereo combined in a seamless workspace
Proceedings of the 24th annual ACM symposium on User interface software and technology
MirageTable: freehand interaction on a projected augmented reality tabletop
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Shape-changing interfaces: a review of the design space and open research questions
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
HoloDesk: direct 3d interactions with a situated see-through display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
inFORM: dynamic physical affordances and constraints through shape and object actuation
Proceedings of the 26th annual ACM symposium on User interface software and technology
Hi-index | 0.01 |
Recent research in 3D user interfaces pushes towards immersive graphics and actuated shape displays. Our work explores the hybrid of these directions, and we introduce sublimation and deposition, as metaphors for the transitions between physical and virtual states. We discuss how digital models, handles and controls can be interacted with as virtual 3D graphics or dynamic physical shapes, and how user interfaces can rapidly and fluidly switch between those representations. To explore this space, we developed two systems that integrate actuated shape displays and augmented reality (AR) for co-located physical shapes and 3D graphics. Our spatial optical see-through display provides a single user with head-tracked stereoscopic augmentation, whereas our handheld devices enable multi-user interaction through video seethrough AR. We describe interaction techniques and applications that explore 3D interaction for these new modalities. We conclude by discussing the results from a user study that show how freehand interaction with physical shape displays and co-located graphics can outperform wand-based interaction with virtual 3D graphics.