A Reference Verification Framework and its Application to a Children's Speech Reading Tracker

  • Authors:
  • Daniel Bolaños;Wayne H. Ward;Ronald A. Cole

  • Affiliations:
  • Boulder Language Technologies, 2960 Center Green Court, Suite 200, Boulder, Colorado;Boulder Language Technologies, 2960 Center Green Court, Suite 200, Boulder, Colorado;Boulder Language Technologies, 2960 Center Green Court, Suite 200, Boulder, Colorado

  • Venue:
  • Proceedings of the 2nd Workshop on Child, Computer and Interaction
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this article we present a novel approach to reference verification, the problem of determining if a speakers utterance matches a specific reference (text) string. We will then discuss its application to a reading tracker system for childrens speech. Unlike other reading tracker systems proposed in the literature, that are built over conventional speech recognizers with ad-hoc language models, the reading tracker described here is designed specifically for the task of estimating whether a child has read an expected sequence of words out loud. The tracker is designed to handle in a natural and flexible way the disfluencies that frequently appear in childrens speech while reading out loud, (e.g., partial-words, repetitions, self-corrections, sentence-restarts, etc), and to overcome problems caused by using language models within the reference verification task. Three mechanisms have been introduced for this purpose: the utilization of filler models and the inclusion of forward and backward inter-word transitions in the static decoding network. While this article focuses on the approach used to overcome errors observed in previous systems, the performance of this system will be evaluated on a corpus of childrens speech while reading out loud and compared to the performance of a traditional reading tracker system that is built on top of a speech recognition system. The results of this comparison will be presented at WOCCI 2009.