Manual deskterity: an exploration of simultaneous pen + touch direct input

Authors:
Ken Hinckley;Koji Yatani;Michel Pahud;Nicole Coddington;Jenny Rodenhouse;Andy Wilson;Hrvoje Benko;Bill Buxton
Affiliations:
Microsoft Research, Redmond, WA, USA;University of Toronto, Toronto, ON, Canada;Microsoft Research, Redmond, WA, USA;Microsoft Corporation, Redmond, WA, USA;Microsoft Corporation, Redmond, WA, USA;Microsoft Research, Redmond, WA, USA;Microsoft Research, Redmond, WA, USA;Microsoft Research, Redmond, WA, USA
Venue:
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Year:
2010

Citing 24
Cited 15

Issues in combining marking and direct manipulation techniques

UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology
The role of natural language in a multimodal interface

UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
The marks are on the knowledge worker

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The design of a GUI paradigm based on tablets, two-hands, and transparency

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
QuickSet: multimodal interaction for distributed applications

MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Sensing techniques for mobile interaction

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
A three-state model of graphical input

INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
Two-handed interaction on a tablet display

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Saving and using encountered information: implications for electronic periodicals

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Documents at Hand: Learning from Paper to Improve Digital Technologies

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Experimental analysis of mode switching techniques in pen-based user interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces

TABLETOP '06 Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems
The springboard: multiple modes in one spring-loaded control

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Keepin' it real: pushing the desktop metaphor with physics, piles and the pen

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
InkSeine: In Situ search for active note taking

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Affordances for manipulation of physical versus digital media on interactive surfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A study on the scalability of non-preferred hand mode manipulation

Proceedings of the 9th international conference on Multimodal interfaces
Usability evaluation considered harmful (some of the time)

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces

AVI '08 Proceedings of the working conference on Advanced visual interfaces
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Codex: a dual screen tablet computer

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sketching User Experiences: Getting the Design Right and the Right Design

Sketching User Experiences: Getting the Design Right and the Right Design
Pictionaire: supporting collaborative design work by integrating physical and digital artifacts

Proceedings of the 2010 ACM conference on Computer supported cooperative work
Investigating multi-touch and pen gestures for diagram editing on interactive surfaces

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

Enabling tangible interaction on capacitive touch panels

UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Tablaction: collaborative brainstorming system with stylus-fingertip interactions on tablet PCs

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
A multi-touch alignment guide for interactive displays

ACM International Conference on Interactive Tabletops and Surfaces
Experimental analysis of touch-screen gesture designs in mobile environments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sensor synaesthesia: touch in motion, and motion in touch

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Grids & guides: multi-touch layout and alignment tools

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Combining bimanual manipulation and pen-based input for 3D modelling

Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
TapSense: enhancing finger interaction on touch surfaces

Proceedings of the 24th annual ACM symposium on User interface software and technology
MicPen: pressure-sensitive pen interaction using microphone with standard touchscreen

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Supporting active reading on pen and touch-operated tabletops

Proceedings of the International Working Conference on Advanced Visual Interfaces
The hold-and-move gesture for multi-touch interfaces

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
High-performance pen + touch modality interactions: a real-time strategy game eSports context

Proceedings of the 25th annual ACM symposium on User interface software and technology
Extended multitouch: recovering touch posture and differentiating users using a depth camera

Proceedings of the 25th annual ACM symposium on User interface software and technology
Empirical evaluation of uni- and bimodal pen and touch interaction properties on digital tabletops

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Your left hand can do it too!: investigating intermanual, symmetric gesture transfer on touchscreens

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Manual Deskterity is a prototype digital drafting table that supports both pen and touch input. We explore a division of labor between pen and touch that flows from natural human skill and differentiation of roles of the hands. We also explore the simultaneous use of pen and touch to support novel compound gestures.