Towards the improvement of statistical translation models using linguistic features

  • Authors:
  • Alicia Pérez;Inés Torres;Francisco Casacuberta

  • Affiliations:
  • Departamento de Electricidad y Electrónica, Facultad de Ciencia y Tecnología, Universidad del País Vasco;Departamento de Electricidad y Electrónica, Facultad de Ciencia y Tecnología, Universidad del País Vasco;Departamento de Sistemas Informáticos y Computación, Institut Tecnològic d’Informàtica, Universidad Politécnica de Valencia

  • Venue:
  • FinTAL'06 Proceedings of the 5th international conference on Advances in Natural Language Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Statistical translation models can be inferred from bilingual samples whenever enough training data are available. However, bilingual corpora are usually too scarce resources so as to get reliable statistical models, particularly, when we are dealing with very inflected languages, or with agglutinative languages, where many words appear just once. Such events often distort the statistics. In order to cope with this problem, we have turned to morphological knowledge. Instead of dealing directly with running words, we also take advantage of lemmas, thus, producing the translation in two stages. In the first stage we transform the source sentence into a lemmatized target sentence, and in the second stage we convert the lemmatized target sentence into the target full forms.