Creating a spoken impact: encouraging vocalization through audio visual feedback in children with ASD

Authors:
Joshua Hailpern;Karrie Karahalios;James Halle
Affiliations:
University of Illinois, Urbana, IL, USA;University of Illinois, Urbana, IL, USA;University of Illinois, Champaign, IL, USA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2009

Citing 13
Cited 11

Toward the use of speech and natural language technology in intervention for a language-disordered population

Assets '98 Proceedings of the third international ACM conference on Assistive technologies
Modeling pronunciation variation for ASR: a survey of the literature

Speech Communication - Special issue on modeling pronunciation variation for automatic speech recognition
Virtual environments for social skills training: the importance of scaffolding in practice

Proceedings of the fifth international ACM conference on Assistive technologies
The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations

VL '96 Proceedings of the 1996 IEEE Symposium on Visual Languages
Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment

Proceedings of the 2005 conference on Interaction design and children
Storytelling with a virtual peer as an intervention for children with autism

ACM SIGACCESS Accessibility and Computing
Attention analysis in interactive software for children with autism

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
From the war room to the living room: decision support for home-based therapy teams

CSCW '06 Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work
Grow and know: understanding record-keeping needs for tracking the development of young children

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
VCode and VData: illustrating a new framework for supporting the video annotation workflow

AVI '08 Proceedings of the working conference on Advanced visual interfaces
A3: a coding guideline for HCI+autism research using video annotation

Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Playing with virtual peers: bootstrapping contingent discourse in children with autism

ICLS'08 Proceedings of the 8th international conference on International conference for the learning sciences - Volume 2
Seeing more: visualizing audio cues

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II

A3: HCI Coding Guideline for Research Using Video Annotation to Assess Behavior of Nonverbal Subjects with Computer-Based Intervention

ACM Transactions on Accessible Computing (TACCESS)
Talking points: the differential impact of real-time computer generated audio/visual feedback on speech-like & non-speech-like vocalizations in low functioning children with ASD

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Vocsyl: visualizing syllable production for children with ASD and speech delays

Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
Developing a multimedia environment to aid in vocalization for people on the autism spectrum: a user-centered design approach

ICCHP'10 Proceedings of the 12th international conference on Computers helping people with special needs
Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders

Personal and Ubiquitous Computing
Phonetic shapes: an interactive, sonic guest book

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays

Proceedings of the Designing Interactive Systems Conference
Visual feedback of acoustic data for speech therapy: model and design parameters

Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound
Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
sPeAK-MAN: towards popular gameplay for speech therapy

Proceedings of The 9th Australasian Conference on Interactive Entertainment: Matters of Life and Death
TalkBetter: family-driven mobile intervention care for children with language delay

Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Quantified Score

Hi-index	0.01

Visualization

Abstract

One hallmark difficulty of children with Autism Spectrum Disorder (ASD) centers on communication and speech. Research into computer visualizations of voice has been shown to influence conversational patterns and allow users to reflect upon their speech. In this paper, we present the Spoken Impact Project (SIP), an effort to examine the effect of audio and visual feedback on vocalizations in low-functioning children with ASD by providing them with additional means of understanding and exploring their voice. This research spans over 12 months, including the creation of multiple software packages and detailed analysis of more than 20 hours of experimental video. SIP demonstrates the potential of computer generated audio and visual feedback to encourage vocalizations of children with ASD.