Multi-environment model adaptation based on vector Taylor series for robust speech recognition

  • Authors:

  • Yong Lü;Haiyang Wu;Lin Zhou;Zhenyang Wu

  • Affiliations:

  • School of Information Science and Engineering, Southeast University, Nanjing 210096, China;School of Information Science and Engineering, Southeast University, Nanjing 210096, China;School of Information Science and Engineering, Southeast University, Nanjing 210096, China;School of Information Science and Engineering, Southeast University, Nanjing 210096, China

  • Venue:
  • Pattern Recognition
  • Year:
  • 2010

Quantified Score

Hi-index 0.02

Visualization

Abstract

In this paper, we propose a multi-environment model adaptation method based on vector Taylor series (VTS) for robust speech recognition. In the training phase, the clean speech is contaminated with noise at different signal-to-noise ratio (SNR) levels to produce several types of noisy training speech and each type is used to obtain a noisy hidden Markov model (HMM) set. In the recognition phase, the HMM set which best matches the testing environment is selected, and further adjusted to reduce the environmental mismatch by the VTS-based model adaptation method. In the proposed method, the VTS approximation based on noisy training speech is given and the testing noise parameters are estimated from the noisy testing speech using the expectation-maximization (EM) algorithm. The experimental results indicate that the proposed multi-environment model adaptation method can significantly improve the performance of speech recognizers and outperforms the traditional model adaptation method and the linear regression-based multi-environment method.