Phrase sets for evaluating text entry techniques

Authors:
I. Scott MacKenzie;R. William Soukoreff
Affiliations:
York University, Toronto, Ontario, Canada and University of Tampere, Tampere, Finland;York University, Toronto, Ontario, Canada
Venue:
CHI '03 Extended Abstracts on Human Factors in Computing Systems
Year:
2003

Citing 4
Cited 158

The design and evaluation of a high-performance soft keyboard

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
LetterWise: prefix-based disambiguation for mobile text input

Proceedings of the 14th annual ACM symposium on User interface software and technology
Mobile text entry using three keys

Proceedings of the second Nordic conference on Human-computer interaction
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A comparison of consecutive and concurrent input text entry techniques for mobile phones

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Model for non-expert text entry speed on 12-button phone keypads

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Performance of menu-augmented soft keyboards

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Twiddler typing: one-handed chording text entry for mobile phones

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Comparing the immediate usability of graffiti 2 and virtual keyboard

CHI '04 Extended Abstracts on Human Factors in Computing Systems
MouthType: text entry by hand and mouth

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Recent developments in text-entry error rate measurement

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Writing with a joystick: a comparison of date stamp, selection keyboard, and EdgeWrite

GI '04 Proceedings of the 2004 Graphics Interface Conference
Quikwriting as a multi-device text entry method

Proceedings of the third Nordic conference on Human-computer interaction
Effect of foreign language on text transcription performance: Finns writing English

Proceedings of the third Nordic conference on Human-computer interaction
On-line adjustment of dwell time for target selection by gaze

Proceedings of the third Nordic conference on Human-computer interaction
Text entry from power wheelchairs: edgewrite for joysticks and touchpads

Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Alphabetically constrained keypad designs for text entry on mobile devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An empirical study of typing rates on mini-QWERTY keyboards

CHI '05 Extended Abstracts on Human Factors in Computing Systems
An enhanced multitap text entry method with predictive next-letter highlighting

CHI '05 Extended Abstracts on Human Factors in Computing Systems
FeelTip: tactile input device for small wearable information appliances

CHI '05 Extended Abstracts on Human Factors in Computing Systems
User modeling for individuals with disabilities: a pilot study of word prediction

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
LetterEase: Improving text entry on a handheld device via letter reassignment

OZCHI '05 Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future
Investigating text input methods for mobile phones

Telematics and Informatics
A new error metric for text entry method evaluation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Text entry using a dual joystick game controller

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Trackball text entry for people with motor impairments

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Few-key text entry revisited: mnemonic gestures on four keys

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Integrating isometric joysticks into mobile phones for text entry

CHI '06 Extended Abstracts on Human Factors in Computing Systems
Can spatial mnemonics accelerate the learning of text input chords?

Proceedings of the working conference on Advanced visual interfaces
AdapTex: contextually adaptive text entry for mobiles

Proceedings of the 8th conference on Human-computer interaction with mobile devices and services
In-stroke word completion

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
From letters to words: efficient stroke-based word completion for trackball text entry

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Indirect text entry using one or two keys

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Unipad: single stroke text entry with language-based acceleration

Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Children's phrase set for text input method evaluations

Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Analyzing the input stream for character- level errors in unconstrained text entry evaluations

ACM Transactions on Computer-Human Interaction (TOCHI)
Bimanual text entry using game controllers: Relying on users' spatial familiarity with QWERTY

Interacting with Computers
One-key keyboard: a very small QWERTY keyboard supporting text entry for wearable computing

OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Revisiting and validating a model of two-thumb text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Game controller text entry with alphabetic and multi-tap selection keyboards

CHI '07 Extended Abstracts on Human Factors in Computing Systems
Empirical investigation into the effect of orientation on text readability in tabletop displays

ECSCW'05 Proceedings of the ninth conference on European Conference on Computer Supported Cooperative Work
TwoStick: writing with a game controller

GI '07 Proceedings of Graphics Interface 2007
Text Entry Systems: Mobility, Accessibility, Universality

Text Entry Systems: Mobility, Accessibility, Universality
Five-key text input using rhythmic mappings

Proceedings of the 9th international conference on Multimodal interfaces
Now Dasher! Dash away!: longitudinal study of fast text entry by Eye Gaze

Proceedings of the 2008 symposium on Eye tracking research & applications
Eye typing using word and letter prediction and a fixation algorithm

Proceedings of the 2008 symposium on Eye tracking research & applications
Graffiti vs. unistrokes: an empirical comparison

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Automatic whiteout++: correcting mini-QWERTY typing errors using keypress timing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
EdgeWrite with integrated corner sequence help

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Investigating the effectiveness of tactile feedback for mobile touchscreens

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Letterscroll: text entry using a wheel for visually impaired users

CHI '08 Extended Abstracts on Human Factors in Computing Systems
User errors on scanning keyboards: Empirical study, model and design principles

Interacting with Computers
TrueKeys: identifying and correcting typing errors for people with motor impairments

Proceedings of the 13th international conference on Intelligent user interfaces
Improved word list ordering for text entry on ambiguous keypads

Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Experimental evaluations of the Twiddler one-handed chording mobile keyboard

Human-Computer Interaction
Seven-segment input 7SI: evaluation expérimentale dans des situations dégradées de mobilité

Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Fast gaze typing with an adjustable dwell time

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Text entry performance of state of the art unconstrained handwriting recognition: a longitudinal user study

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Audio or tactile feedback: which modality when?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tactile feedback for predictive text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Low-cost gaze interaction: ready to deliver the promises

CHI '09 Extended Abstracts on Human Factors in Computing Systems
A technique for incorporating dynamic paths in lab-based mobile evaluations

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
ExpECT: an expanded error categorisation method for text input

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
A comparison of the impact of avoidance cues in hazard avoidance during evaluation of text entry

BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
What you see is what you worry about: errors -- real and imagined

BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
Mid-air text input techniques for very large wall displays

Proceedings of Graphics Interface 2009
BigKey: A Virtual Keyboard for Mobile Devices

Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction
A model of two-thumb chording on a phone keypad

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Pressure-based text entry for mobile devices

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Causes of Simultaneous Keystrokes in Children and Adults

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
3DKey: An Accordion-Folding Based Virtual Keyboard for Small Screen

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Fast track article: An evaluation of stylus-based text entry methods on handheld devices studied in different user mobility states

Pervasive and Mobile Computing
The one-key challenge: searching for a fast one-key text entry method

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
SmartKey: a multi purpose target expansion based virtual keyboard

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Text input error categorisation: solving character level insertion ambiguities using Zero Time analysis

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Distal tactile feedback for text entry on tabletop computers

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Performance of finger-operated soft keyboard with and without offset zoom on the pressed key

Mobility '09 Proceedings of the 6th International Conference on Mobile Technology, Application & Systems
TapList: testing the effectiveness of tap access to the n-best list in pen-based text entry

Mobility '09 Proceedings of the 6th International Conference on Mobile Technology, Application & Systems
Multiple mouse text entry for single-display groupware

Proceedings of the 2010 ACM conference on Computer supported cooperative work
Usability guided key-target resizing for soft keyboards

Proceedings of the 15th international conference on Intelligent user interfaces
Evaluation of a low-cost open-source gaze tracker

Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
Context switching for fast key selection in text entry applications

Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
BlinkWrite2: an improved text entry method using eye blinks

Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
Predicting the cost of error correction in character-based text entry technologies

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A simple index for multimodal flexibility

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluation of text entry methods for Korean mobile phones, a user study

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
BetweenKeys: looking for room between keys

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
Button keyboard: a very small keyboard with universal usability for wearable computing

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
SAK: Scanning ambiguous keyboard for efficient one-key text entry

ACM Transactions on Computer-Human Interaction (TOCHI)
Multi-modal text entry and selection on a mobile device

Proceedings of Graphics Interface 2010
A practical examination of multimodal feedback and guidance signals for mobile touchscreen keyboards

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Stroke++: a hybrid chinese input method for touch screen mobile phones

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Scanning methods and language modeling for binary switch typing

SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
Eyes-free text entry with error correction on touchscreen mobile devices

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Motor efficiency of text entry in a combination of a soft keyboard and unistrokes

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
UniWise: LetterWise pour Unistroke, la prédiction de texte pour améliorer la reconnaissance de geste

Conference Internationale Francophone sur I'Interaction Homme-Machine
KeyGliss: un clavier ambigu prédictif basé sur un appui-glissé

Conference Internationale Francophone sur I'Interaction Homme-Machine
Text entry with KeyScretch

Proceedings of the 16th international conference on Intelligent user interfaces
RemoteTouch: touch-screen-like interaction in the tv viewing environment

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sampling representative phrase sets for text entry experiments: a procedure and public resource

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Ease of juggling: studying the effects of manual multitasking

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Predictive error behavior model of on-screen keyboard users

CHI '11 Extended Abstracts on Human Factors in Computing Systems
MultiPress: releasing keys for multitap segmentation

CHI '11 Extended Abstracts on Human Factors in Computing Systems
Gathering text entry metrics on android devices

CHI '11 Extended Abstracts on Human Factors in Computing Systems
Input observer: measuring text entry and pointing performance from naturalistic everyday computer use

CHI '11 Extended Abstracts on Human Factors in Computing Systems
AVIN (Assisted visual interactive notepad): a novel interface design to expedite the eye writing experience

UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: users diversity - Volume Part II
A versatile dataset for text entry evaluations based on genuine mobile emails

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
The 1line keyboard: a QWERTY layout in a single line

Proceedings of the 24th annual ACM symposium on User interface software and technology
1 thumb, 4 buttons, 20 words per minute: design and evaluation of H4-writer

Proceedings of the 24th annual ACM symposium on User interface software and technology
Extending mobile user ambient awareness for nomadic text entry

Proceedings of the 23rd Australian Computer-Human Interaction Conference
Applying mobile device soft keyboards to collaborative multitouch tabletop displays: design and evaluation

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Mobile phones as a tactile display for tabletop typing

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Asynchronous fixed-grid scanning with dynamic codes

SLPAT '11 Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies
Evaluation of an ambiguous-keyboard prototype scanning-system with word and character disambiguation

BCS '10 Proceedings of the 24th BCS Interaction Specialist Group Conference
Tactile feedback for ambient awareness in mobile interactions

BCS '10 Proceedings of the 24th BCS Interaction Specialist Group Conference
No-look notes: accessible eyes-free multi-touch text entry

Pervasive'10 Proceedings of the 8th international conference on Pervasive Computing
Towards online adaptation and personalization of key-target resizing for mobile devices

Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Performance comparisons of phrase sets and presentation styles for text entry evaluations

Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
The potential of dwell-free eye-typing for fast assistive gaze communication

Proceedings of the Symposium on Eye Tracking Research and Applications
Measuring the performance of gaze and speech for text input

Proceedings of the Symposium on Eye Tracking Research and Applications
Taming wild behavior: the input observer for obtaining text entry and mouse pointing measures from everyday computer use

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Personalized input: improving ten-finger touchscreen typing through automatic adaptation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Observational and experimental investigation of typing behaviour using virtual keyboards for mobile devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multidimensional pareto optimization of touchscreen keyboards for speed, familiarity and improved spell checking

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An exploratory study of eye typing fundamentals: dwell time, text entry rate, errors, and workload

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing and evaluating text entry methods

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Back keyboard: a physical keyboard on backside of mobile phone using qwerty

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Reducing visual demand for gestural text input on touchscreen devices

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Comparison of video-based pointing and selection techniques for hands-free text entry

Proceedings of the International Working Conference on Advanced Visual Interfaces
SpeeG: a multimodal speech- and gesture-based text input solution

Proceedings of the International Working Conference on Advanced Visual Interfaces
Effect of multiple visual feedbacks for text entry on touch screen

BCS-HCI '11 Proceedings of the 25th BCS Conference on Human-Computer Interaction
Comparison of two text entry methods on interactive TV

Proceedings of the 10th European conference on Interactive tv and video
Comparing direct and remote tactile feedback on interactive surfaces

EuroHaptics'12 Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part I
Establishing a baseline for text entry for a multi-touch virtual keyboard

International Journal of Human-Computer Studies
Modeling text input for single-switch scanning

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II
Touch behavior with different postures on soft smartphone keyboards

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
QWERTH: an optimized semi-ambiguous keyboard design

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion
Bimanual gesture keyboard

Proceedings of the 25th annual ACM symposium on User interface software and technology
GripSense: using built-in sensors to detect hand posture and pressure on commodity mobile phones

Proceedings of the 25th annual ACM symposium on User interface software and technology
Restorable backspace

Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
Towards the keyboard of oz: learning individual soft-keyboard models from raw optical sensor data

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Design and Evaluation of Soft Keyboards for Brahmic Scripts

ACM Transactions on Asian Language Information Processing (TALIP)
Freehand gestural text entry for interactive TV

Proceedings of the 11th european conference on Interactive TV and video
Octopus: evaluating touchscreen keyboard correction and recognition algorithms via

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
TapBoard: making a touch screen keyboard more touchable

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Improving two-thumb text entry on touchscreen devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ContextType: using hand posture information to improve mobile touch screen text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
iGrasp: grasp-based adaptive keyboard for mobile devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Writing handwritten messages on a small touchscreen

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
SpeeG2: a speech- and gesture-based interface for efficient controller-free text input

Proceedings of the 15th ACM on International conference on multimodal interaction
Tilt-Based support for multimodal text entry on touchscreen smartphones: using pitch and roll

UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: applications and services for quality of life - Volume Part III
Effects of hand drift while typing on touchscreens

Proceedings of Graphics Interface 2013
Pseudo-pressure detection and its use in predictive text entry on touchscreens

Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
Evaluation of a new error prevention technique for mobile touchscreen text entry

Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
Disambiguation of imprecise input with one-dimensional rotational text entry

ACM Transactions on Computer-Human Interaction (TOCHI)
Complementing text entry evaluations with a composition task

ACM Transactions on Computer-Human Interaction (TOCHI)
User identification using raw sensor data from typing on interactive displays

Proceedings of the 19th international conference on Intelligent User Interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

In evaluations of text entry methods, participants enter phrases of text using a technique of interest while performance data are collected. This paper describes and publishes (via the internet) a collection of 500 phrases for such evaluations. Utility programs are also provided to compute statistical properties of the phrase set, or any other phrase set. The merits of using a pre-defined phrase set are described as are methodological considerations, such as attaining results that are generalizable and the possible addition of punctuation and other characters.