Occlusion-aware interfaces

Authors:
Daniel Vogel;Ravin Balakrishnan
Affiliations:
University of Toronto, Toronto, ON, Canada;University of Toronto, Toronto, ON, Canada
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2010

Citing 19
Cited 22

Pen computing: a technology overview and a vision

ACM SIGCHI Bulletin
Beyond paper: supporting active reading with free form digital ink annotations

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
More than dotting the i's --- foundations for crossing-based interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Fluid interaction techniques for the control and annotation of digital video

Proceedings of the 16th annual ACM symposium on User interface software and technology
Improving menu placement strategies for pen input

GI '04 Proceedings of the 2004 Graphics Interface Conference
CrossY: a crossing-based drawing application

Proceedings of the 17th annual ACM symposium on User interface software and technology
Interacting with hidden content using content-aware free-space transparency

Proceedings of the 17th annual ACM symposium on User interface software and technology
CoR2Ds

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Distant freehand pointing and clicking on very large, high resolution displays

Proceedings of the 18th annual ACM symposium on User interface software and technology
Precise selection techniques for multi-touch screens

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Fluid inking: augmenting the medium of free-form inking with gestures

GI '06 Proceedings of Graphics Interface 2006
Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
HybridPointing: fluid switching between absolute and relative pointing with a direct input device

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Interactive environment-aware display bubbles

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Shift: a technique for operating pen-based interfaces using touch

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Shadow tracking on multi-touch tables

AVI '08 Proceedings of the working conference on Advanced visual interfaces
Hand occlusion with tablet-sized direct pen input

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Occlusion-aware menu design for digital tabletops

CHI '09 Extended Abstracts on Human Factors in Computing Systems

Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Importance-driven compositing window management

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Eden: a professional multitouch tool for constructing virtual organic environments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Magic desk: bringing multi-touch surfaces into desktop work

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Exploiting new interaction techniques for disaster control management using multitouch-, tangible- and pen-based-interaction

HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
Evaluating physical/virtual occlusion management techniques for horizontal displays

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Usage and recognition of finger orientation for multi-touch tabletop interaction

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Design of unimanual multi-finger pie menu interaction

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Display-adaptive window management for irregular surfaces

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Extending interactions into hoverspace using reflected light

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Investigating effects of visual and tactile feedback on spatial coordination in collaborative handheld systems

Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Hand occlusion on a multi-touch tabletop

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Occlusion-aware interaction techniques for tabletop systems

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Touching the micron: tactile interactions with an optical tweezer

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
PhantomPen: virtualization of pen head for digital drawing free from pen occlusion & visual parallax

Proceedings of the 25th annual ACM symposium on User interface software and technology
Extended multitouch: recovering touch posture and differentiating users using a depth camera

Proceedings of the 25th annual ACM symposium on User interface software and technology
Comparing elicited gestures to designer-created gestures for selection above a multitouch surface

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
SnapRail: a tabletop user interface widget for addressing occlusion by physical objects

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Messy tabletops: clearing up the occlusion problem

CHI '13 Extended Abstracts on Human Factors in Computing Systems
TextTearing: opening white space for digital ink annotation

Proceedings of the 26th annual ACM symposium on User interface software and technology
ObjecTop: occlusion awareness of physical objects on interactive tabletops

Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Quantified Score

Hi-index	0.01

Visualization

Abstract

We define occlusion-aware interfaces as interaction techniques which know what area of the display is currently occluded, and use this knowledge to counteract potential problems and/or utilize the hidden area. As a case study, we describe the Occlusion-Aware Viewer, which identifies important regions hidden beneath the hand and displays them in a non-occluded area using a bubble-like callout. To determine what is important, we use an application agnostic image processing layer. For the occluded area, we use a user configurable, real-time version of Vogel et al.'s [21] geometric model. In an evaluation with a simultaneous monitoring task, we find the technique can successfully mitigate the effects of occlusion, although issues with ambiguity and stability suggest further refinements. Finally, we present designs for three other occlusion-aware techniques for pop-ups, dragging, and a hidden widget.