Discriminative input stream combination for conditional random field phone recognition

  • Authors:
  • Ilana Heintz;Eric Fosler-Lussier;Chris Brew

  • Affiliations:
  • Department of Linguistics and Department of Computer Science and Engineering, The Ohio State University, Columbus, OH;Department of Linguistics and Department of Computer Science and Engineering, The Ohio State University, Columbus, OH;Department of Linguistics and Department of Computer Science and Engineering, The Ohio State University, Columbus, OH

  • Venue:
  • IEEE Transactions on Audio, Speech, and Language Processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent studies, we and others have found that conditional random fields (CRFs) can be effectively used to perform phone classification and recognition tasks by combining non-Gaussian distributed representations of acoustic input. In previous work by I. Heintz et al. (Latent phonetic analysis: Use of singular value decomposition to determine features for CRF phone recognition, Proc. ICASSP, pp. 4541-4544, 2008), we experimented with combining phonological feature posterior estimators and phone posterior estimators within a CRF framework; we found that treating posterior estimates as terms in a "phoneme information retrieval" task allowed for a more effective use of multiple posterior streams than directly feeding these acoustic representations to the CRF recognizer. In this paper, we examine some of the design choices in our previous work, and extend our results to up to six acoustic feature streams. We concentrate on feature design, rather than feature selection, to find the best way of combining features for introduction into a log-linear model. We improve upon our previous work to find that several different dimensionality reduction techniques (SVD, PARAFAC2, KLT), followed by a nonlinear transform provided by a multilayer perceptron, provides a significant gain in phone recognition accuracy on the TIMIT task.