2005 Special Issue: Framewise phoneme classification with bidirectional LSTM and other neural network architectures

  • Authors:
  • Alex Graves;Jürgen Schmidhuber

  • Affiliations:
  • IDSIA, Galleria 2, 6928 Manno-Lugano, Switzerland;IDSIA, Galleria 2, 6928 Manno-Lugano, Switzerland and TU Munich, Boltzmannstr. 3, 85748 Garching, Munich, Germany

  • Venue:
  • Neural Networks - 2005 Special issue: IJCNN 2005
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present bidirectional Long Short Term Memory (LSTM) networks, and a modified, full gradient version of the LSTM learning algorithm. We evaluate Bidirectional LSTM (BLSTM) and several other network architectures on the benchmark task of framewise phoneme classification, using the TIMIT database. Our main findings are that bidirectional networks outperform unidirectional ones, and Long Short Term Memory (LSTM) is much faster and also more accurate than both standard Recurrent Neural Nets (RNNs) and time-windowed Multilayer Perceptrons (MLPs). Our results support the view that contextual information is crucial to speech processing, and suggest that BLSTM is an effective architecture with which to exploit it.