The design and evaluation of multi-finger mouse emulation techniques

Authors:
Justin Matejka;Tovi Grossman;Jessica Lo;George Fitzmaurice
Affiliations:
Autodesk Research, Toronto, ON, Canada;Autodesk Research, Toronto, ON, Canada;Autodesk Research, Toronto, ON, Canada;Autodesk Research, Toronto, ON, Canada
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2009

Citing 27
Cited 21

Improving the accuracy of touch screens: an experimental evaluation of three strategies

CHI '88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
High precision touchscreens: design strategies and comparisons with a mouse

International Journal of Man-Machine Studies
The Rockin'Mouse: integral 3D manipulation on a plane

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Issues and techniques in touch-sensitive tablet input

SIGGRAPH '85 Proceedings of the 12th annual conference on Computer graphics and interactive techniques
DiamondTouch: a multi-user touch technology

Proceedings of the 14th annual ACM symposium on User interface software and technology
SmartSkin: an infrastructure for freehand manipulation on interactive surfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
High precision touch screen interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tracking menus

Proceedings of the 16th annual ACM symposium on User interface software and technology
Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays

Proceedings of the 16th annual ACM symposium on User interface software and technology
Bare-hand human-computer interaction

Proceedings of the 2001 workshop on Perceptive user interfaces
Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper

Proceedings of the 2001 workshop on Perceptive user interfaces
Multi-finger gestural interaction with 3d volumetric displays

Proceedings of the 17th annual ACM symposium on User interface software and technology
Visual tracking of bare fingers for interactive surfaces

Proceedings of the 17th annual ACM symposium on User interface software and technology
Interacting with large displays from a distance with vision-tracked multi-finger gestural input

Proceedings of the 18th annual ACM symposium on User interface software and technology
Low-cost multi-touch sensing through frustrated total internal reflection

Proceedings of the 18th annual ACM symposium on User interface software and technology
Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces

TABLETOP '06 Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems
Hover widgets: using the tracking state to extend the capabilities of pen-operated devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Precise selection techniques for multi-touch screens

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Fluid DTMouse: better mouse support for touch-based interactions

Proceedings of the working conference on Advanced visual interfaces
Multi-finger cursor techniques

GI '06 Proceedings of Graphics Interface 2006
HybridPointing: fluid switching between absolute and relative pointing with a direct input device

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Direct-touch vs. mouse input for tabletop displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Shift: a technique for operating pen-based interfaces using touch

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Rubbing and tapping for precise and rapid selection on touch-screen displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Indirect mappings of multi-touch input using one and two hands

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces

AVI '08 Proceedings of the working conference on Advanced visual interfaces
Shadow tracking on multi-touch tables

AVI '08 Proceedings of the working conference on Advanced visual interfaces

Detecting and leveraging finger orientation for interaction with direct-touch surfaces

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Hand distinction for multi-touch tabletop interaction

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
The design and evaluation of multitouch marking menus

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Design and evaluation of interaction models for multi-touch mice

Proceedings of Graphics Interface 2010
Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
SurfaceMouse: supplementing multi-touch interaction with a virtual mouse

Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Integrating 2D mouse emulation with 3D manipulation for visualizations on a multi-touch table

ACM International Conference on Interactive Tabletops and Surfaces
Multitouch finger registration and its applications

Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction
An interactive multi-touch sketching interface for diffusion curves

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A multi-touch system for 3D modelling and animation

SG'11 Proceedings of the 11th international conference on Smart graphics
Integrated rotation and translation for 3d manipulation on multi-touch interactive surfaces

SG'11 Proceedings of the 11th international conference on Smart graphics
Medusa: a proximity-aware multi-touch tabletop

Proceedings of the 24th annual ACM symposium on User interface software and technology
Comparing multi-touch interaction techniques for manipulation of an abstract parameter space

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Design of unimanual multi-finger pie menu interaction

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Bimanual marking menu for near surface interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The hold-and-move gesture for multi-touch interfaces

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Finger-based multitouch interface for performing 3D CAD operations

International Journal of Human-Computer Studies
Multi-tap sliders: advancing touch interaction for parameter adjustment

Proceedings of the 2013 international conference on Intelligent user interfaces
An evaluation of state switching methods for indirect touch systems

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A remote pointing technique using pull-out

HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
I feel it in my fingers: haptic guidance on touch surfaces

Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction

Quantified Score

Hi-index	0.01

Visualization

Abstract

We explore the use of multi-finger input to emulate full mouse functionality, such as the tracking state, three buttons, and chording. We first present the design space for such techniques, which serves as a guide for the systematic investigation of possible solutions. We then perform a series of pilot studies to come up with recommendations for the various aspects of the design space. These pilot studies allow us to arrive at a recommended technique, the SDMouse. In a formal study, the SDMouse was shown to significantly improve performance in comparison to previously developed mouse emulation techniques.