Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip
I3D '99 Proceedings of the 1999 symposium on Interactive 3D graphics
Illuminating clay: a 3-D tangible interface for landscape analysis
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Dynamic Shader Lamps: Painting on Movable Objects
ISAR '01 Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR'01)
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Paper windows: interaction techniques for digital paper
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Exploring Curved Anatomic Structures with Surface Sections
Proceedings of the 14th IEEE Visualization 2003 (VIS'03)
Multicue HMM-UKF for Real-Time Contour Tracking
IEEE Transactions on Pattern Analysis and Machine Intelligence
SIGGRAPH '05 ACM SIGGRAPH 2005 Emerging technologies
As-rigid-as-possible surface modeling
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
Twend: twisting and bending as new interaction gesture in mobile devices
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Video puppetry: a performative interface for cutout animation
ACM SIGGRAPH Asia 2008 papers
Towards more paper-like input: flexible input devices for foldable interaction styles
Proceedings of the 21st annual ACM symposium on User interface software and technology
Proceedings of the 21st annual ACM symposium on User interface software and technology
A 3D Flexible and Tangible Magic Lens in Augmented Reality
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
WUW - wear Ur world: a wearable gestural interface
CHI '09 Extended Abstracts on Human Factors in Computing Systems
PaperLens: advanced magic lens interaction above the tabletop
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
How users manipulate deformable displays as input devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Technical Section: Realistic cloth augmentation in single view video under occlusions
Computers and Graphics
Combining multiple depth cameras and projectors for interactions on, above and between surfaces
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Probabilistic deformable surface tracking from multiple videos
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Evaluating effects of structural holds on pointing and dragging performance with flexible displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Xpaaand: interaction techniques for rollable displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
OmniTouch: wearable multitouch interaction everywhere
Proceedings of the 24th annual ACM symposium on User interface software and technology
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Proceedings of the 24th annual ACM symposium on User interface software and technology
FoldMe: interacting with double-sided foldable displays
Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
MirageTable: freehand interaction on a projected augmented reality tabletop
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
HoloDesk: direct 3d interactions with a situated see-through display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Going beyond the surface: studying multi-layer interaction above the tabletop
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Kinetic device: designing interactions with a deformable mobile interface
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Tilt displays: designing display surfaces with multi-axis tilting and actuation
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Feeling it: the roles of stiffness, deformation range and feedback in the control of deformable ui
Proceedings of the 14th ACM international conference on Multimodal interaction
Direct Model-Based Tracking of 3D Object Deformations in Depth and Color Video
International Journal of Computer Vision
Novel user interaction styles with flexible/rollable screens
Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI
Responsive design and development: methods, technologies and current issues
ICWE'13 Proceedings of the 13th international conference on Web Engineering
jamSheets: thin interfaces with tunable stiffness enabled by layer jamming
Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
DeforMe: projection-based visualization of deformable surfaces using invisible textures
SIGGRAPH Asia 2013 Emerging Technologies
| Hi-index | 0.01 |
Flexpad is an interactive system that combines a depth camera and a projector to transform sheets of plain paper or foam into flexible, highly deformable, and spatially aware handheld displays. We present a novel approach for tracking deformed surfaces from depth images in real time. It captures deformations in high detail, is very robust to occlusions created by the user's hands and fingers, and does not require any kind of markers or visible texture. As a result, the display is considerably more deformable than in previous work on flexible handheld displays, enabling novel applications that leverage the high expressiveness of detailed deformation. We illustrate these unique capabilities through three application examples: curved cross-cuts in volumetric images, deforming virtual paper characters, and slicing through time in videos. Results from two user studies show that our system is capable of detecting complex deformations and that users are able to perform them quickly and precisely.