Beyond: collapsible input device for direct 3D manipulation beyond the screen

Authors:
Jinha Lee;Surat Teerapittayanon;Hiroshi Ishii
Affiliations:
Massachusettes Institute of Technology, Cambridge, MA, USA;Massachusettes Institute of Technology, Cambridge, MA, USA;Massachusettes Institute of Technology, Cambridge, MA, USA
Venue:
UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Year:
2010

Citing 6
Cited 1

The design and evaluation of selection techniques for 3D volumetric displays

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
WYSIWYF Display: A Visual/Haptic Interface to Virtual Environment

Presence: Teleoperators and Virtual Environments
A screen-space formulation for 2D and 3D direct manipulation

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Interactions in the air: adding further depth to interactive tabletops

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Exploring tangible and direct touch interfaces for manipulating 2D and 3D information on a digital table

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Beyond: collapsible tools and gestures for computational design

CHI '10 Extended Abstracts on Human Factors in Computing Systems

PhantomPen: virtualization of pen head for digital drawing free from pen occlusion & visual parallax

Proceedings of the 25th annual ACM symposium on User interface software and technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

What would it be like to reach into a screen and manipulate or design virtual objects as in real world? We present Beyond, a collapsible input device for direct 3D manipulation. When pressed against a screen, Beyond collapses in the physical world and extends into the digital space of the screen, such that users can perceive that they are inserting the tool into the virtual space. Beyond allows users to directly interact with 3D media, avoiding separation between the users' input and the displayed 3D graphics without requiring special glasses or wearables, thereby enabling users to select, draw, and sculpt in 3D virtual space unfettered. We describe detailed interaction techniques, implementation and application scenarios focused on 3D geometric design and prototyping.