Correcting phoneme recognition errors in learning word pronunciation through speech interaction

  • Authors:
  • Xiang Zuo;Taisuke Sumii;Naoto Iwahashi;Mikio Nakano;Kotaro Funakoshi;Natsuki Oka

  • Affiliations:
  • Kyoto Institute of Technology, Hashigami-cho, Matsugasaki, Sakyo-ku, Kyoto 606-8585, Japan;Kyoto Institute of Technology, Hashigami-cho, Matsugasaki, Sakyo-ku, Kyoto 606-8585, Japan;National Institute of Information and Communications Technology, 3-5 Hikaridai, Seika, Soraku, Kyoto 619-0289, Japan;Honda Research Institute Japan Co. Ltd., 8-1 Honcho, Wako-shi, Saitama 351-0188, Japan;Honda Research Institute Japan Co. Ltd., 8-1 Honcho, Wako-shi, Saitama 351-0188, Japan;Kyoto Institute of Technology, Hashigami-cho, Matsugasaki, Sakyo-ku, Kyoto 606-8585, Japan

  • Venue:
  • Speech Communication
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a method called Interactive Phoneme Update (IPU) that enables users to teach systems the pronunciation (phoneme sequences) of words in the course of speech interaction. Using the method, users can correct mis-recognized phoneme sequences by repeatedly making correction utterances according to the system responses. The originalities of this method are: (1) word-segment-based correction that allows users to use word segments for locating mis-recognized phonemes based on open-begin-end dynamic programming matching and generalized posterior probability, (2) history-based correction that utilizes the information of phoneme sequences that were recognized and corrected previously in the course of interactive learning of each word. Experimental results show that the proposed IPU method reduces the error rate by a factor of three over a previously proposed maximum-likelihood-based method.