Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric

Authors:
R. William Soukoreff;I. Scott MacKenzie
Affiliations:
York University, Toronto, Ontario, Canada;University of Tampere, Tampere, Finland and York University, Toronto, Ontario, Canada
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2003

Citing 6
Cited 89

Half-QWERTY: a one-handed keyboard facilitating skill transfer from QWERTY

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Dasher—a data entry interface using continuous gestures and language models

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
LetterWise: prefix-based disambiguation for mobile text input

Proceedings of the 14th annual ACM symposium on User interface software and technology
A character-level error analysis technique for evaluating text entry methods

Proceedings of the second Nordic conference on Human-computer interaction
Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic

CHI '01 Extended Abstracts on Human Factors in Computing Systems
KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques

Mobile HCI '02 Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction

Phrase sets for evaluating text entry techniques

CHI '03 Extended Abstracts on Human Factors in Computing Systems
Twiddler typing: one-handed chording text entry for mobile phones

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Comparing the immediate usability of graffiti 2 and virtual keyboard

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Recent developments in text-entry error rate measurement

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Writing with a joystick: a comparison of date stamp, selection keyboard, and EdgeWrite

GI '04 Proceedings of the 2004 Graphics Interface Conference
Effect of foreign language on text transcription performance: Finns writing English

Proceedings of the third Nordic conference on Human-computer interaction
Text entry from power wheelchairs: edgewrite for joysticks and touchpads

Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
An empirical study of typing rates on mini-QWERTY keyboards

CHI '05 Extended Abstracts on Human Factors in Computing Systems
A comparative usability study of two Japanese gaze typing systems

Proceedings of the 2006 symposium on Eye tracking research & applications
An intuitive text input method for touch wheels

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A new error metric for text entry method evaluation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Trackball text entry for people with motor impairments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Few-key text entry revisited: mnemonic gestures on four keys

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Integrating isometric joysticks into mobile phones for text entry

CHI '06 Extended Abstracts on Human Factors in Computing Systems
The Korean twiddler: one-handed chording text entry for Korean mobile phones

CHI '06 Extended Abstracts on Human Factors in Computing Systems
A robust design for accessible text entry

ACM SIGACCESS Accessibility and Computing
From letters to words: efficient stroke-based word completion for trackball text entry

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Indirect text entry using one or two keys

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Children's phrase set for text input method evaluations

Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Analyzing the input stream for character- level errors in unconstrained text entry evaluations

ACM Transactions on Computer-Human Interaction (TOCHI)
A study of the usability of handwriting recognition for text entry by children

Interacting with Computers
Bimanual text entry using game controllers: Relying on users' spatial familiarity with QWERTY

Interacting with Computers
One-key keyboard: a very small QWERTY keyboard supporting text entry for wearable computing

OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Game controller text entry with alphabetic and multi-tap selection keyboards

CHI '07 Extended Abstracts on Human Factors in Computing Systems
TwoStick: writing with a game controller

GI '07 Proceedings of Graphics Interface 2007
Text Entry Systems: Mobility, Accessibility, Universality

Text Entry Systems: Mobility, Accessibility, Universality
Longitudinal evaluation of discrete consecutive gaze gestures for text entry

Proceedings of the 2008 symposium on Eye tracking research & applications
Now Dasher! Dash away!: longitudinal study of fast text entry by Eye Gaze

Proceedings of the 2008 symposium on Eye tracking research & applications
Automatic whiteout++: correcting mini-QWERTY typing errors using keypress timing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
EdgeWrite with integrated corner sequence help

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Investigating the effectiveness of tactile feedback for mobile touchscreens

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Design and evaluation of korean text entry methods for mobile phones

CHI '08 Extended Abstracts on Human Factors in Computing Systems
Sibylle, An Assistive Communication System Adapting to the Context and Its User

ACM Transactions on Accessible Computing (TACCESS)
TrueKeys: identifying and correcting typing errors for people with motor impairments

Proceedings of the 13th international conference on Intelligent user interfaces
Text entry for mobile devices and users with severe motor impairments: handiglyph, a primitive shapes based onscreen keyboard

Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Investigating the viability of scroll-wheel interfaced mobile phones for text entry

Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology
Experimental evaluations of the Twiddler one-handed chording mobile keyboard

Human-Computer Interaction
Seven-segment input 7SI: evaluation expérimentale dans des situations dégradées de mobilité

Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Fast gaze typing with an adjustable dwell time

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Audio or tactile feedback: which modality when?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Low-cost gaze interaction: ready to deliver the promises

CHI '09 Extended Abstracts on Human Factors in Computing Systems
ExpECT: an expanded error categorisation method for text input

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
MECE method for categorising typing errors

BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
BigKey: A Virtual Keyboard for Mobile Devices

Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
3DKey: An Accordion-Folding Based Virtual Keyboard for Small Screen

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
SmartKey: a multi purpose target expansion based virtual keyboard

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Distal tactile feedback for text entry on tabletop computers

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Mobile text entry metrics for field studies

IASTED-HCI '07 Proceedings of the Second IASTED International Conference on Human Computer Interaction
Performance of finger-operated soft keyboard with and without offset zoom on the pressed key

Mobility '09 Proceedings of the 6th International Conference on Mobile Technology, Application & Systems
Multiple mouse text entry for single-display groupware

Proceedings of the 2010 ACM conference on Computer supported cooperative work
Crosstrainer: testing the use of multimodal interfaces in situ

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluation of text entry methods for Korean mobile phones, a user study

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Handheld haptic display with braille I/O

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
An accessible and usable soft keyboard

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
Speaking through text: the influence of real-time text on discourse and usability in IM

Proceedings of the 16th ACM international conference on Supporting group work
UniWise: LetterWise pour Unistroke, la prédiction de texte pour améliorer la reconnaissance de geste

Conference Internationale Francophone sur I'Interaction Homme-Machine
KeyGliss: un clavier ambigu prédictif basé sur un appui-glissé

Conference Internationale Francophone sur I'Interaction Homme-Machine
KeyTilt: un clavier logiciel par inclinaison

Conference Internationale Francophone sur I'Interaction Homme-Machine
Text entry with KeyScretch

Proceedings of the 16th international conference on Intelligent user interfaces
Simpleflow: enhancing gestural interaction with gesture prediction, abbreviation and autocompletion

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I
The 1line keyboard: a QWERTY layout in a single line

Proceedings of the 24th annual ACM symposium on User interface software and technology
Extending mobile user ambient awareness for nomadic text entry

Proceedings of the 23rd Australian Computer-Human Interaction Conference
Applying mobile device soft keyboards to collaborative multitouch tabletop displays: design and evaluation

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
A ubiquitous social community portal service for social networking with convenient accessibility

ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
Towards online adaptation and personalization of key-target resizing for mobile devices

Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Performance comparisons of phrase sets and presentation styles for text entry evaluations

Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
The potential of dwell-free eye-typing for fast assistive gaze communication

Proceedings of the Symposium on Eye Tracking Research and Applications
Taming wild behavior: the input observer for obtaining text entry and mouse pointing measures from everyday computer use

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Personalized input: improving ten-finger touchscreen typing through automatic adaptation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Beyond QWERTY: augmenting touch screen keyboards with multi-touch gestures for non-alphanumeric input

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An exploratory study of eye typing fundamentals: dwell time, text entry rate, errors, and workload

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing and evaluating text entry methods

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Continuous edgewrite: dictionary-based disambiguation instead of explicit segmentation by the user

Proceedings of the International Working Conference on Advanced Visual Interfaces
Input finger detection for nonvisual touch screen text entry in Perkinput

Proceedings of Graphics Interface 2012
Establishing a baseline for text entry for a multi-touch virtual keyboard

International Journal of Human-Computer Studies
Adaptation of AAC to the context communication: a real improvement for the user illustration through the VITIPI word completion

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II
An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Bimanual gesture keyboard

Proceedings of the 25th annual ACM symposium on User interface software and technology
WeSlide: gestural text entry for elderly users of interactive television

Proceedings of the 11th european conference on Interactive TV and video
TapBoard: making a touch screen keyboard more touchable

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ContextType: using hand posture information to improve mobile touch screen text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Text entry by gazing and smiling

Advances in Human-Computer Interaction
Tilt-Based support for multimodal text entry on touchscreen smartphones: using pitch and roll

UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: applications and services for quality of life - Volume Part III
Pseudo-pressure detection and its use in predictive text entry on touchscreens

Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
Evaluation of a new error prevention technique for mobile touchscreen text entry

Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
Disambiguation of imprecise input with one-dimensional rotational text entry

ACM Transactions on Computer-Human Interaction (TOCHI)
Complementing text entry evaluations with a composition task

ACM Transactions on Computer-Human Interaction (TOCHI)

Quantified Score

Hi-index	0.01

Visualization

Abstract

We describe and identify shortcomings in two statistics recently introduced to measure accuracy in text entry evaluations: the minimum string distance (MSD) error rate and keystrokes per character (KSPC). To overcome the weaknesses, a new framework for error analysis is developed and demonstrated. It combines the analysis of the presented text, input stream (keystrokes), and transcribed text. New statistics include a unified total error rate, combining two constituent error rates: the corrected error rate (errors committed but corrected) and the not corrected error rate (errors left in the transcribed text). The framework includes other measures including error correction efficiency, participant conscientiousness, utilised bandwidth, and wasted bandwidth. A text entry study demonstrating the new methodology is described.