Recovery of rare words in lecture speech

  • Authors:
  • Stefan Kombrink;Mirko Hannemann;Lukáý Burget;Hynek Heřmanský

  • Affiliations:
  • Speech@FIT, Brno University of Technology, Czech Republic;Speech@FIT, Brno University of Technology, Czech Republic;Speech@FIT, Brno University of Technology, Czech Republic;Speech@FIT, Brno University of Technology, Czech Republic and Johns Hopkins University, Baltimore

  • Venue:
  • TSD'10 Proceedings of the 13th international conference on Text, speech and dialogue
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The vocabulary used in speech usually consists of two types of words: a limited set of common words, shared across multiple documents, and a virtually unlimited set of rare words, each of which might appear a few times only in particular documents. In most documents, however, these rare words are not seen at all. The first type of words is typically included in the language model of an automatic speech recognizer (ASR) and is thus widely referred to as invocabulary (IV). Words of the second type are missing in the language model and thus are called out-of-vocabulary (OOV). However, these words usually carry important information. We use a hybrid word/sub-word recognizer to detect OOV words occurring in English talks and describe them as sequences of sub-words. We detected about one third of all OOV words, and were able to recover the correct spelling for 26.2% of all detections by using a phoneme-to-grapheme (P2G) conversion trained on the recognition dictionary. By omitting detections corresponding to recovered IV words, we were able to increase the precision of the OOV detection substantially.