Incorporating source-language paraphrases into phrase-based SMT with confusion networks

  • Authors:
  • Jie Jiang;Jinhua Du;Andy Way

  • Affiliations:
  • Dublin City University, Glasnevin, Dublin, Ireland;Xi'an University of Technology, Xi'an, Shaanxi, China;Dublin City University, Glasnevin, Dublin, Ireland

  • Venue:
  • SSST-5 Proceedings of the Fifth Workshop on Syntax, Semantics and Structure in Statistical Translation
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

To increase the model coverage, source-language paraphrases have been utilized to boost SMT system performance. Previous work showed that word lattices constructed from paraphrases are able to reduce out-of-vocabulary words and to express inputs in different ways for better translation quality. However, such a word-lattice-based method suffers from two problems: 1) path duplications in word lattices decrease the capacities for potential paraphrases; 2) lattice decoding in SMT dramatically increases the search space and results in poor time efficiency. Therefore, in this paper, we adopt word confusion networks as the input structure to carry source-language paraphrase information. Similar to previous work, we use word lattices to build word confusion networks for merging of duplicated paths and faster decoding. Experiments are carried out on small-, medium- and large-scale English-Chinese translation tasks, and we show that compared with the word-lattice-based method, the decoding time on three tasks is reduced significantly (up to 79%) while comparable translation quality is obtained on the large-scale task.