Automatically assessing the ABCs: Verification of children's spoken letter-names and letter-sounds

Authors:
Matthew P. Black;Abe Kazemzadeh;Joseph Tepperman;Shrikanth S. Narayanan
Affiliations:
Signal Analysis & Interpretation Laboratory, University of Southern California, Los Angeles, CA;Signal Analysis & Interpretation Laboratory, University of Southern California, Los Angeles, CA;Rosetta Stone Labs, Boulder, CO;Signal Analysis & Interpretation Laboratory, University of Southern California, Los Angeles, CA
Venue:
ACM Transactions on Speech and Language Processing (TSLP)
Year:
2011

Citing 12
Cited 0

A prototype reading coach that listens

AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Phone-level pronunciation scoring and assessment for interactive language learning

Speech Communication
Making Space for Voice: Technologies to Support Children’s Fantasy and Storytelling

Personal and Ubiquitous Computing
Highly accurate children's speech recognition for interactive reading tutors using subword units

Speech Communication
Automatic pronunciation scoring of words and sentences independent from the non-native's first language

Computer Speech and Language
An overview of spoken language technology for education

Speech Communication
Assessment of emerging reading skills in young native speakers and language learners

Speech Communication
Automatic pronunciation verification of english letter-names for early literacy assessment of preliterate children

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
Optimizing automatic speech recognition for low-proficient non-native speakers

EURASIP Journal on Audio, Speech, and Music Processing - Special issue on atypical speech
Detecting emotional state of a child in a conversational computer game

Computer Speech and Language
Automatic Prediction of Children's Reading Ability for High-Level Literacy Assessment

IEEE Transactions on Audio, Speech, and Language Processing
A Generative Student Model for Scoring Word Reading Skills

IEEE Transactions on Audio, Speech, and Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Automatic literacy assessment is an area of research that has shown significant progress in recent years. Technology can be used to automatically administer reading tasks and analyze and interpret children's reading skills. It has the potential to transform the classroom dynamic by providing useful information to teachers in a repeatable, consistent, and affordable way. While most previous research has focused on automatically assessing children reading words and sentences, assessments of children's earlier foundational skills is needed. We address this problem in this research by automatically verifying preliterate children's pronunciations of English letter-names and the sounds each letter represents (“letter-sounds”). The children analyzed in this study were from a diverse bilingual background and were recorded in actual kindergarten to second grade classrooms. We first manually verified (accept/reject) the letter-name and letter-sound utterances, which serve as the ground-truth in this study. Next, we investigated four automatic verification methods that were based on automatic speech recognition techniques. We attained percent agreement with human evaluations of 90% and 85% for the letter-name and letter-sound tasks, respectively. Humans agree between themselves an average of 95% of the time for both tasks. We discuss the various confounding factors for this assessment task, such as background noise and the presence of disfluencies, that impact automatic verification performance.