Illuminating clay: a 3-D tangible interface for landscape analysis

Authors:
Ben Piper;Carlo Ratti;Hiroshi Ishii
Affiliations:
MIT Media Laboratory, Cambridge, MA;University of Cambridge, Cambridge, UK;MIT Media Laboratory, Cambridge, MA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2002

Citing 9
Cited 86

Interacting with paper on the DigitalDesk

Communications of the ACM - Special issue on computer augmented environments: back to the real world
Passive real-world interface props for neurosurgical visualization

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
3D painting on scanned surfaces

I3D '95 Proceedings of the 1995 symposium on Interactive 3D graphics
Triangles: tangible interface for manipulation and exploration of digital information topography

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Urp: a luminous-tangible workbench for urban planning and design

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Table-Top Spatially-Augmented Reality: Bringing Physical Models to Life with Projected Imagery

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Dynamic Shader Lamps: Painting on Movable Objects

ISAR '01 Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR'01)
Haptic holography: an early computational plastic

Haptic holography: an early computational plastic
Emerging frameworks for tangible user interfaces

IBM Systems Journal

The actuated workbench: computer-controlled actuation in tabletop tangible interfaces

Proceedings of the 15th annual ACM symposium on User interface software and technology
A spatially-aware tangible interface for computer-aided design

CHI '03 Extended Abstracts on Human Factors in Computing Systems
Coordination in Pervasive Computing Environments

WETICE '03 Proceedings of the Twelfth International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises
The TAC paradigm: unified conceptual framework to represent Tangible User Interfaces

Proceedings of the Latin American conference on Human-computer interaction
A widget framework for augmented interaction in SCAPE

Proceedings of the 16th annual ACM symposium on User interface software and technology
A portable system for anywhere interactions

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Let's get physical: the learning benefits of interacting in digitally augmented physical spaces

Computers & Education
PHOXEL-SPACE: an interface for exploring volumetric data with physical voxels

DIS '04 Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques
The proactive desk: a new haptic display system for a digital desk using a 2-DOF linear induction motor

Presence: Teleoperators and Virtual Environments - Special issue: IEEE VR 2003
On tangible user interfaces, humans and spatiality

Personal and Ubiquitous Computing
A taxonomy for and analysis of tangible interfaces

Personal and Ubiquitous Computing
Location-aware projection with robust 3-D viewing point detection and fast image deformation

Proceedings of the 12th annual ACM international conference on Multimedia
Bringing Clay and Sand into Digital Design — Continuous Tangible user Interfaces

BT Technology Journal
Immersive Design of DNA Molecules with a Tangible Interface

VIS '04 Proceedings of the conference on Visualization '04
Material light: exploring expressive materials

Personal and Ubiquitous Computing
Glume: exploring materiality in a soft augmented modular modeling system

CHI '06 Extended Abstracts on Human Factors in Computing Systems
ModelCraft: capturing freehand annotations and edits on physical 3D models

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
An interface for virtual 3D sculpting via physical proxy

Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia
Making digital shapes by hand

ACM SIGGRAPH 2006 Courses
A computer support tool for the early stages of architectural design

Interacting with Computers
Mechanical constraints as computational constraints in tabletop tangible interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tangible user interfaces in context and theory

CHI '07 Extended Abstracts on Human Factors in Computing Systems
Expressive interactions - supporting collaboration in urban design

Proceedings of the 2007 international ACM conference on Supporting group work
Situated play in a tangible interface and adaptive audio museum guide

Personal and Ubiquitous Computing
Tangible bits: beyond pixels

Proceedings of the 2nd international conference on Tangible and embedded interaction
GeoTUI: a tangible user interface for geoscience

Proceedings of the 2nd international conference on Tangible and embedded interaction
The tangible user interface and its evolution

Communications of the ACM - Organic user interfaces
Organic user interfaces: designing computers in any way, shape, or form

Communications of the ACM - Organic user interfaces
Handsaw: tangible exploration of volumetric data by direct cut-plane projection

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability of multi-scale interfaces for 3d workbench displays

Presence: Teleoperators and Virtual Environments
Towards an account of intuitiveness

Behaviour & Information Technology
AR-Jig: A Handheld Tangible User Interface for Modification of 3D Digital Form via 2D Physical Curve

ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Peripheral tangible interaction by analytic design

Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Spime builder: a tangible interface for designing hyperlinked objects

Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
TinkerSheets: using paper forms to control and visualize tangible simulations

Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Experiential role of artefacts in cooperative design

Proceedings of the fourth international conference on Communities and technologies
Tangible user interface laboratory: Teaching tangible interaction design in practice

Artificial Intelligence for Engineering Design, Analysis and Manufacturing
A tangible design tool for sketching materials in products

Artificial Intelligence for Engineering Design, Analysis and Manufacturing
The ModelCraft framework: Capturing freehand annotations and edits to facilitate the 3D model design process using a digital pen

ACM Transactions on Computer-Human Interaction (TOCHI)
PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity

Proceedings of the 22nd annual ACM symposium on User interface software and technology
A reconfigurable ferromagnetic input device

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Qu'est-ce qu'une surface d'affichage?: une analyse rétrospective

Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Beyond flat surface computing: challenges of depth-aware and curved interfaces

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Using augmentations as bridges from concrete to abstract representations

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models

Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction
Towards tabletop interaction with everyday artifacts via pressure imaging

Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction
Physics on display: tangible graphics on hexagonal bezel-less screens

Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction
3D spatial touch system based on time-of-flight camera

WSEAS Transactions on Information Science and Applications
Mudpad: fluid haptics for multitouch surfaces

CHI '10 Extended Abstracts on Human Factors in Computing Systems
Tangible User Interfaces: Past, Present, and Future Directions

Foundations and Trends in Human-Computer Interaction
Cubeexplorer: an evaluation of interaction techniques in architectural education

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
Bimanual handheld mixed reality interfaces for urban planning

Proceedings of the International Conference on Advanced Visual Interfaces
Combining multiple depth cameras and projectors for interactions on, above and between surfaces

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Tactile camera vs. tangible camera: taking advantage of small physical artefacts to navigate into large data collection

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Bateau ivre: an artistic markerless outdoor mobile augmented reality installation on a riverboat

Proceedings of the international conference on Multimedia
Cloth displays: interacting with drapable textile screens

Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Tangible bots: interaction with active tangibles in tabletop interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Recompose: direct and gestural interaction with an actuated surface

CHI '11 Extended Abstracts on Human Factors in Computing Systems
Constructing virtual 3D models with physical building blocks

CHI '11 Extended Abstracts on Human Factors in Computing Systems
Metamorphic light: a tabletop tangible interface using deformation of plain paper

ACM SIGGRAPH 2011 Posters
ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation

Proceedings of the 24th annual ACM symposium on User interface software and technology
deForm: an interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch

Proceedings of the 24th annual ACM symposium on User interface software and technology
Radical atoms: beyond tangible bits, toward transformable materials

interactions
FuSA touch display: a furry and scalable multi-touch display

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Building Urban Narratives: Collaborative Site-Seeing and Envisioning in the MR Tent

Computer Supported Cooperative Work
MirageTable: freehand interaction on a projected augmented reality tabletop

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive surface that have dynamic softness control

Proceedings of the International Working Conference on Advanced Visual Interfaces
NeonDough: crafting with interactive lighted clay

ACM SIGGRAPH 2012 Posters
ClaytricSurface: an interactive surface with dynamic softness control capability

ACM SIGGRAPH 2012 Emerging Technologies
Comparing direct and remote tactile feedback on interactive surfaces

EuroHaptics'12 Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part I
Fluid surface: interactive water surface display for viewing information in a bathroom

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Feel through window: simultaneous geometry and texture display based on lateral force

SIGGRAPH Asia 2012 Emerging Technologies
Development of and experimentation on deformable three-dimensional figures by the use of polystyrene beads, a pressure sensor, and an air pump

Proceedings of the 1st workshop on Smart Material Interfaces: A Material Step to the Future
Physical games or digital games?: comparing support for mental projection in tangible and virtual representations of a problem-solving task

Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Touch style: creativity in tangible experience design

Proceedings of the 9th ACM Conference on Creativity & Cognition
Flexpad: highly flexible bending interactions for projected handheld displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Polka dot: the garden of water spirits

ACM SIGGRAPH 2013 Posters
Supporting freeform modelling in spatial augmented reality environments with a new deformable material

AUIC '12 Proceedings of the Thirteenth Australasian User Interface Conference - Volume 126
Designing augmented reality for the classroom

Computers & Education
Skeu the evolution: skeuomorphs, style, and the material of tangible interactions

Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
DeforMe: projection-based visualization of deformable surfaces using invisible textures

SIGGRAPH Asia 2013 Emerging Technologies
Polka dot: the garden of water spirits

SIGGRAPH Asia 2013 Emerging Technologies
Intangibles wear materiality via material composition

Personal and Ubiquitous Computing
Structures, forms, and stuff: the materiality and medium of interaction

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper describes a novel system for the real-time computational analysis of landscape models. Users of the system - called Illuminating Clay - alter the topography of a clay landscape model while the changing geometry is captured in real-time by a ceiling-mounted laser scanner. A depth image of the model serves as an input to a library of landscape analysis functions. The results of this analysis are projected back into the workspace and registered with the surfaces of the model.We describe a scenario for which this kind of tool has been developed and we review past work that has taken a similar approach. We describe our system architecture and highlight specific technical issues in its implementation.We conclude with a discussion of the benefits of the system in combining the tangible immediacy of physical models with the dynamic capabilities of computational simulations.