Combining EBMT, SMT, TM and IR technologies for quality and scale

Authors:
Sandipan Dandapat;Sara Morrissey;Andy Way;Joseph van Genabith
Affiliations:
CNGL, Dublin City University, Glasnevin, Dublin, Ireland;CNGL, Dublin City University, Glasnevin, Dublin, Ireland;Applied Language Solutions, Delph, UK;CNGL, Dublin City University, Glasnevin, Dublin, Ireland
Venue:
EACL 2012 Proceedings of the Joint Workshop on Exploiting Synergies between Information Retrieval and Machine Translation (ESIRMT) and Hybrid Approaches to Machine Translation (HyTra)
Year:
2012

Citing 16
Cited 0

A framework of a mechanical translation between Japanese and English by analogy principle

Proc. of the international NATO symposium on Artificial and human intelligence
The String-to-String Correction Problem

Journal of the ACM (JACM)
Learning Translation Templates from Bilingual Translation Examples

Applied Intelligence
On Approximate String Matching

Proceedings of the 1983 International FCT-Conference on Fundamentals of Computation Theory
A systematic comparison of various statistical alignment models

Computational Linguistics
Trans Type: Development-Evaluation Cycles to Boost Translator's Productivity

Machine Translation
BLEU: a method for automatic evaluation of machine translation

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Translation spotting for translation memories

HLT-NAACL-PARALLEL '03 Proceedings of the HLT-NAACL 2003 Workshop on Building and using parallel texts: data driven machine translation and beyond - Volume 3
Purest ever example-based machine translation: Detailed presentation and assessment

Machine Translation
Introduction to Information Retrieval

Introduction to Information Retrieval
Moses: open source toolkit for statistical machine translation

ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Enhancing the Bilingual Concordancer TransSearch with Word-Level Alignment

Canadian AI '09 Proceedings of the 22nd Canadian Conference on Artificial Intelligence: Advances in Artificial Intelligence
Statistical Machine Translation

Statistical Machine Translation
OpenMaTrEx: a free/open-source marker-driven example-based machine translation system

IceTAL'10 Proceedings of the 7th international conference on Advances in natural language processing
Cunei: open-source machine translation with relevance-based models of each translation instance

Machine Translation
The CMU-EBMT machine translation system

Machine Translation

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a hybrid statistical machine translation (SMT)-example-based MT (EBMT) system that shows significant improvement over both SMT and EBMT baseline systems. First we present a runtime EBMT system using a subsentential translation memory (TM). The EBMT system is further combined with an SMT system for effective hybridization of the pair of systems. The hybrid system shows significant improvement in translation quality (0.82 and 2.75 absolute BLEU points) for two different language pairs (English--Turkish (En--Tr) and English--French (En--Fr)) over the baseline SMT system. However, the EBMT approach suffers from significant time complexity issues for a runtime approach. We explore two methods to make the system scalable at runtime. First, we use an heuristic-based approach. Secondly, we use an IR-based indexing technique to speed up the time-consuming matching procedure of the EBMT system. The index-based matching procedure substantially improves run-time speed without affecting translation quality.