A Comparison of ID3 and Backpropagation for English Text-To-Speech Mapping

  • Authors:
  • Thomas G. Dietterich;Hermann Hild;Ghulum Bakiri

  • Affiliations:
  • Department of Computer Science, 303 Dearborn Hall, Oregon State University, Corvallis, OR 97331-3202. tgd@cs.orst.edu;Universität Karlsruhe, Institut für Logik, Komplexität, and Deduktionssysteme, Am Fasanengarten 5, 76131 Karlsruhe, Germany. hhild@il3dl.ira.uka.de;Department of Computer Science, University of Bahrain, Isa Town, Bahrain

  • Venue:
  • Machine Learning
  • Year:
  • 1995

Quantified Score

Hi-index 0.00

Visualization

Abstract

The performance of the error backpropagation (BP) and ID3 learning algorithms was compared on the task of mapping English text to phonemes and stresses. Under the distributed output code developed by Sejnowski and Rosenberg, it is shown that BP consistently out-performs ID3 on this task by several percentage points. Three hypotheses explaining this difference were explored: (a) ID3 is overfitting the training data, (b) BP is able to share hidden units across several output units and hence can learn the output units better, and (c) BP captures statistical information that ID3 does not. We conclude that only hypothesis (c) is correct. By augmenting ID3 with a simple statistical learning procedure, the performance of BP can be closely matched. More complex statistical procedures can improve the performance of both BP and ID3 substantially in this domain.