Towards technology-assisted co-construction with communication partners

  • Authors:
  • Brian Roark;Andrew Fowler;Richard Sproat;Christopher Gibbons;Melanie Fried-Oken

  • Affiliations:
  • Oregon Health & Science University;Oregon Health & Science University;Oregon Health & Science University;Oregon Health & Science University;Oregon Health & Science University

  • Venue:
  • SLPAT '11 Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we examine the idea of technology-assisted co-construction, where the communication partner of an AAC user can make guesses about the intended messages, which are included in the user's word completion/prediction interface. We run some human trials to simulate this new interface concept, with subjects predicting words as the user's intended message is being generated in real time with specified typing speeds. Results indicate that people can provide substantial keystroke savings by providing word completion or prediction, but that the savings are not as high as n-gram language models. Interestingly, the language model and human predictions are complementary in certain key ways -- humans doing a better job in some circumstances on contextually salient nouns. We discuss implications of the enhanced co-construction interface for real-time message generation in AAC direct selection devices.