Evaluating word prediction: framing keystroke savings

Authors:
Keith Trnka;Kathleen F. McCoy
Affiliations:
University of Delaware, Newark, DE;University of Delaware, Newark, DE
Venue:
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Year:
2008

Citing 5
Cited 2

The rôle of natural language processing in alternative and augmentative communication

Natural Language Engineering
Semantic knowledge in word completion

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Text prediction systems: a survey

Universal Access in the Information Society
Corpus studies in word prediction

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
The effects of word prediction on communication rate for AAC

NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers

Enhancing digital inclusion with an English pseudo-syllabic keyboard

USAB'10 Proceedings of the 6th international conference on HCI in work and learning, life and leisure: workgroup human-computer interaction and usability engineering
Basic word completion and prediction for hebrew

SPIRE'12 Proceedings of the 19th international conference on String Processing and Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

Researchers typically evaluate word prediction using keystroke savings, however, this measure is not straightforward. We present several complications in computing keystroke savings which may affect interpretation and comparison of results. We address this problem by developing two gold standards as a frame for interpretation. These gold standards measure the maximum keystroke savings under two different approximations of an ideal language model. The gold standards additionally narrow the scope of deficiencies in a word prediction system.