Improving statistical machine translation using shallow linguistic knowledge

  • Authors:
  • Young-Sook Hwang;Andrew Finch;Yutaka Sasaki

  • Affiliations:
  • ETRI Speech and Language Information Research Center, 161 Yuseong-gu, Daejeon 305-700, Republic of Korea;ATR SLC Research Labs 2-2-2 Hikaridai Seika-cho Soraku-gun Kyoto, 619-0288, Japan;ATR SLC Research Labs 2-2-2 Hikaridai Seika-cho Soraku-gun Kyoto, 619-0288, Japan

  • Venue:
  • Computer Speech and Language
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe methods for improving the performance of statistical machine translation (SMT) between four linguistically different languages, i.e., Chinese, English, Japanese, and Korean by using morphosyntactic knowledge. For the purpose of reducing the translation ambiguities and generating grammatically correct and fluent translation output, we address the use of shallow linguistic knowledge, that is: (1) enriching a word with its morphosyntactic features, (2) obtaining shallow linguistically-motivated phrase pairs, (3) iteratively refining word alignment using filtered phrase pairs, and (4) building a language model from morphosyntactically enriched words. Previous studies reported that the introduction of syntactic features into SMT models resulted in only a slight improvement in performance in spite of the heavy computational expense, however, this study demonstrates the effectiveness of morphosyntactic features, when reliable, discriminative features are used. Our experimental results show that word representations that incorporate morphosyntactic features significantly improve the performance of the translation model and language model. Moreover, we show that refining the word alignment using fine-grained phrase pairs is effective in improving system performance.