Generalizing sampling-based multilingual alignment

  • Authors:
  • Adrien Lardilleux;François Yvon;Yves Lepage

  • Affiliations:
  • LIMSI-CNRS, Orsay Cedex, France;LIMSI-CNRS, Orsay Cedex, France and University Paris Sud, Orsay Cedex, France;Graduate School of Information, Production and Systems, Waseda University, Kitakyuusyuu-si, Japan 808-0135

  • Venue:
  • Machine Translation
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Sub-sentential alignment is the process by which multi-word translation units are extracted from sentence-aligned multilingual parallel texts. This process is required, for instance, in the course of training statistical machine translation systems. Standard approaches typically rely on the estimation of several probabilistic models of increasing complexity and on the use of various heuristics, that make it possible to align, first isolated words, then, by extension, groups of words. In this paper, we explore an alternative approach which relies on a much simpler principle: the comparison of occurrence profiles in sub-corpora obtained by sampling. After analyzing the strengths and weaknesses of this approach, we show how to improve the detection of multi-word translation units and evaluate these improvements on machine translation tasks.