Experimental analysis of mode switching techniques in pen-based user interfaces

Authors:
Yang Li;Ken Hinckley;Zhiwei Guan;James A. Landay
Affiliations:
University of California, Berkeley, Berkeley, CA;Microsoft Research, Redmond, WA;University of Washington, Seattle, WA;University of Washington, Seattle, WA and Intel Research Seattle, Seattle, WA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2005

Citing 11
Cited 68

Measuring the true cost of command selection: techniques and results

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User learning and performance with marking menus

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Two-handed input in a compound task

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pen-based interaction techniques for organizing material on an electronic whiteboard

Proceedings of the 10th annual ACM symposium on User interface software and technology
The music notepad

Proceedings of the 11th annual ACM symposium on User interface software and technology
DENIM: finding a tighter fit between tools and practice for Web site design

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The audio notebook: paper and pen interaction with structured speech

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Fluid interaction techniques for the control and annotation of digital video

Proceedings of the 16th annual ACM symposium on User interface software and technology
Stylus input and editing without prior selection of mode

Proceedings of the 16th annual ACM symposium on User interface software and technology
Pressure widgets

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CrossY: a crossing-based drawing application

Proceedings of the 17th annual ACM symposium on User interface software and technology

Design and analysis of delimiters for selection-action pen gesture phrases in scriboli

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Stroke break analysis: a practical method to study timeout value for handwriting recognition input

Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
"LINC-ing" the family: the participatory design of an inkable family calendar

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The springboard: multiple modes in one spring-loaded control

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Hover widgets: using the tracking state to extend the capabilities of pen-operated devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Bubble radar: efficient pen-based interaction

Proceedings of the working conference on Advanced visual interfaces
Concurrent bimanual stylus interaction: a study of non-preferred hand mode manipulation

GI '06 Proceedings of Graphics Interface 2006
Phrasing techniques for multi-stroke selection gestures

GI '06 Proceedings of Graphics Interface 2006
Mobile interaction using paperweight metaphor

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Videotater: an approach for pen-based digital video segmentation and tagging

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Multi-layer interaction for digital tables

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
InkSeine: In Situ search for active note taking

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Seconds matter: improving distributed coordination bytracking and visualizing display trajectories

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ExperiScope: an analysis tool for interaction data

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pressure marks

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Augmenting the mouse with pressure sensitive input

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Connector semantics for sketched diagram recognition

AUIC '07 Proceedings of the eight Australasian conference on User interface - Volume 64
Papiercraft: A gesture-based command system for interactive paper

ACM Transactions on Computer-Human Interaction (TOCHI)
A study on the scalability of non-preferred hand mode manipulation

Proceedings of the 9th international conference on Multimodal interfaces
Simple pen interaction performance of young and older adults using handheld computers

Interacting with Computers
K-sketch: a 'kinetic' sketch pad for novice animators

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Implicit user-adaptive system engagement in speech and pen interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PieCursor: merging pointing and command selection for rapid in-place tool switching

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A model of non-preferred hand mode switching

GI '08 Proceedings of graphics interface 2008
Zoom interaction design for pen-operated portable devices

International Journal of Human-Computer Studies
Relative role of merging and two-handed operation on command selection speed

International Journal of Human-Computer Studies
ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models

Proceedings of the 21st annual ACM symposium on User interface software and technology
An exploration of pen rolling for pen-based interaction

Proceedings of the 21st annual ACM symposium on User interface software and technology
Back-of-device interaction allows creating very small touch devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
P-recognition: you are already recognized

CHI '09 Extended Abstracts on Human Factors in Computing Systems
Handle Flags: efficient and flexible selections for inking applications

Proceedings of Graphics Interface 2009
Computational Support for Sketching in Design: A Review

Foundations and Trends in Human-Computer Interaction
Making Pen-Based Operation More Seamless and Continuous

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
EverybodyLovesSketch: 3D sketching for a broader audience

Proceedings of the 22nd annual ACM symposium on User interface software and technology
The design and evaluation of multitouch marking menus

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Manual deskterity: an exploration of simultaneous pen + touch direct input

CHI '10 Extended Abstracts on Human Factors in Computing Systems
The adaptive hybrid cursor: a pressure-based target selection technique for pen-based user interfaces

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Pen + touch = new tools

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
UIMarks: quick graphical interaction with specific targets

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
DoubleFlip: a motion gesture delimiter for interaction

UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Exploring frame gestures for fluid freehand sketching

Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
Exploring usability and learnability of mode inferencing in pen/tablet interfaces

Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
Design and evaluation of techniques for mobile interaction with dynamic NFC-displays

Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Improving stylus interaction for eMedical forms

Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction
Gesture avatar: a technique for operating mobile user interfaces using gestures

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Experimental analysis of touch-screen gesture designs in mobile environments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SandCanvas: a multi-touch art medium inspired by sand animation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Grips and gestures on a multi-touch pen

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DoubleFlip: a motion gesture delimiter for mobile interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal video annotation for contemporary dance creation

CHI '11 Extended Abstracts on Human Factors in Computing Systems
Conté: multimodal input inspired by an artist's crayon

Proceedings of the 24th annual ACM symposium on User interface software and technology
A creation-tool for contemporary dance using multimodal video annotation

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Optical pressure sensing for tangible user interfaces

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Design of unimanual multi-finger pie menu interaction

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
A-coord input: coordinating auxiliary input streams for augmenting contextual pen-based interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using shear as a supplemental two-dimensional input channel for rich touchscreen interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluation of a multimodal video annotator for contemporary dance

Proceedings of the International Working Conference on Advanced Visual Interfaces
Mode switching techniques through pen and device profiles

Proceedings of the 10th asia pacific conference on Computer human interaction
The hold-and-move gesture for multi-touch interfaces

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Interpreting strokes on paper with a mobile assistant

Proceedings of the 25th annual ACM symposium on User interface software and technology
Microanalysis of active reading behavior to inform design of interactive desktop workspaces

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
An exploration of pen tail gestures for interactions

International Journal of Human-Computer Studies
Direct space-time trajectory control for visual media editing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Kolibri: tiny and fast gestures for large pen-based surfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Error analysis for tablet user interface transfers based on operational knowledge interference

EPCE'13 Proceedings of the 10th international conference on Engineering Psychology and Cognitive Ergonomics: understanding human cognition - Volume Part I
Motion and context sensing techniques for pen computing

Proceedings of Graphics Interface 2013

Quantified Score

Hi-index	0.01

Visualization

Abstract

Inking and gesturing are two central tasks in pen-based user interfaces. Switching between modes for entry of uninterpreted ink and entry of gestures is required by many pen-based user interfaces. Without an appropriate mode switching technique, pen-based interactions in such situations may be inefficient and cumbersome. In this paper, we investigate five techniques for switching between ink and gesture modes in pen interfaces, including a pen-pressure based mode switching technique that allows implicit mode transition. A quantitative experimental study was conducted to evaluate the performance of these techniques. The results suggest that pressing a button with the non-preferred hand offers the fastest performance, while the technique of holding the pen still is significantly slower and more prone to error than the other techniques. Pressure, while promising, did not perform as well as the non-preferred hand button with our current implementation.