Compansion: From research prototype to practical integration
Natural Language Engineering
An architecture for data-to-text systems
ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Using NLG to help language-impaired users tell stories and participate in social dialogues
ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
Using NLG and sensors to support personal narrative for children with complex communication needs
SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
Automatically generating stories from sensor data
Proceedings of the 16th international conference on Intelligent user interfaces
Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems
An off-the-shelf wearable HUD system for support in indoor environments
Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia
| Hi-index | 0.00 |
Currently available commercial Augmentative and Alternative Communication (AAC) technology makes little use of computing power to improve the access to words and phrases for personal narrative, an essential part of social interaction. In this paper, we describe the development and evaluation of a mobile phone application to enable data collection for a personal narrative system for children with severe speech and physical impairments (SSPI). Based on user feedback from the previous project "How was School today?" we developed a modular system where school staff can use a mobile phone to track interaction with people and objects and user location at school. The phone also allows taking digital photographs and recording voice message sets by both school staff and parents/carers at home. These sets can be played back by the child for immediate narrative sharing similar to established AAC device interaction using sequential voice recorders. The mobile phone sends all the gathered data to a remote server. The data can then be used for automatic narrative generation on the child's PC based communication aid. Early results from the ongoing evaluation of the application in a special school with two participants and school staff show that staff were able to track interactions, record voice messages and take photographs. Location tracking was less successful, but was supplemented by timetable information. The participating children were able to play back voice messages and show photographs on the mobile phone for interactive narrative sharing using both direct and switch activated playback options.