SymbolChat: picture-based communication platform for users with intellectual disabilities

  • Authors:
  • Tuuli Keskinen;Tomi Heimonen;Markku Turunen;Juha-Pekka Rajaniemi;Sami Kauppinen

  • Affiliations:
  • TAUCHI, University of Tampere, Tampere, Finland;TAUCHI, University of Tampere, Tampere, Finland;TAUCHI, University of Tampere, Tampere, Finland;TAUCHI, University of Tampere, Tampere, Finland;Laurea University of Applied Sciences, Espoo, Finland

  • Venue:
  • ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce a multimodal picture-based communication platform for users with intellectual disabilities, and results from our user evaluation carried out with the target user group representatives and their assistants. Our current prototype is based on touchscreen input and symbol and text-to-speech output, but supports also mouse and keyboard interaction. The prototype was evaluated in a field study with the help of nine users with varying degrees of intellectual and motor disabilities. Based on our findings, the picture-based approach and our application, SymbolChat, show great potential in providing a tool for users with intellectual disabilities to communicate with other people over the Internet, even without prior knowledge of symbols. The findings highlighted a number of potential improvements to the system, including providing even more input methods for users with physical disabilities, and functionality to support the development of younger users, who are still learning vocabulary and developing their abilities.