Fast Evaluation of Connectionist Language Models

  • Authors:
  • F. Zamora-Martínez;M. J. Castro-Bleda;S. España-Boquera

  • Affiliations:
  • Departamento de Ciencias Físicas, Matemáticas y de la Computación, Universidad CEU-Cardenal Herrera, Alfara del Patriarca (Valencia), Spain 46115;Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain;Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain

  • Venue:
  • IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part I: Bio-Inspired Systems: Computational and Ambient Intelligence
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Connectionist language models offer many advantages over their statistical counterparts, but they also have some drawbacks like a much more expensive computational cost. This paper describes a novel method to overcome this problem. A set of normalization values associated to the most frequent n -gramsis pre-computed and the model is smoothed with lower n -gramconnectionist or statistical models. The proposed approach is favourably compared to standard connectionist language models and with statistical back-off language models.