Manual and automatic evaluation of machine translation between European languages

Authors:
Philipp Koehn;Christof Monz
Affiliations:
University of Edinburgh;University of London
Venue:
StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Year:
2006

Citing 14
Cited 42

Clause restructuring for statistical machine translation

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Shared task: statistical machine translation between European languages

ParaText '05 Proceedings of the ACL Workshop on Building and Using Parallel Texts
NTT system description for the WMT2006 shared task

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Mood at work: Ramses versus Pharaoh

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Stochastic inversion transduction grammars for obtaining word phrases for phrase-based statistical machine translation

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
PORTAGE: with smoothed phrase tables and segment choice models

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Syntax augmented machine translation via chart parsing

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
TALP phrase-based statistical translation system for European language pairs

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Phramer: an open source statistical phrase-based translator

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Language models and reranking for machine translation

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Constraining the phrase-based, joint probability statistical translation model

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Microsoft research treelet translation system: NAACL 2006 Europarl evaluation

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
N-gram-based SMT system enhanced with reordering patterns

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
The LDV-COMBO system for SMT

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation

Statistical machine translation

ACM Computing Surveys (CSUR)
Pivot language approach for phrase-based statistical machine translation

Machine Translation
Introducing a Translation Dictionary into Phrase-Based SMT

IEICE - Transactions on Information and Systems
Minimum Error-Rate Training in Statistical Machine Translation Using Structural SVMs

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
Syntactic reordering integrated with phrase-based SMT

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Random restarts in minimum error rate training for statistical machine translation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Domain adaptation for statistical machine translation with domain dictionary and monolingual corpora

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Syntactic reordering for English-Arabic phrase-based machine translation

Semitic '09 Proceedings of the EACL 2009 Workshop on Computational Approaches to Semitic Languages
Syntactic reordering integrated with phrase-based SMT

SSST '08 Proceedings of the Second Workshop on Syntax and Structure in Statistical Translation
Inversion transduction grammar for joint phrasal translation modeling

SSST '07 Proceedings of the NAACL-HLT 2007/AMTA Workshop on Syntax and Structure in Statistical Translation
Human evaluation of machine translation through binary system comparisons

StatMT '07 Proceedings of the Second Workshop on Statistical Machine Translation
Ngram-based statistical machine translation enhanced with multiple weighted reordering hypotheses

StatMT '07 Proceedings of the Second Workshop on Statistical Machine Translation
The ISL phrase-based MT system for the 2007 ACL workshop on statistical machine translation

StatMT '07 Proceedings of the Second Workshop on Statistical Machine Translation
UCB system description for the WMT 2007 shared task

StatMT '07 Proceedings of the Second Workshop on Statistical Machine Translation
Linguistic features for automatic evaluation of heterogenous MT systems

StatMT '07 Proceedings of the Second Workshop on Statistical Machine Translation
The TALP-UPC Ngram-based statistical machine translation system for ACL-WMT 2008

StatMT '08 Proceedings of the Third Workshop on Statistical Machine Translation
Improving English-Spanish statistical machine translation: experiments in domain adaptation, sentence paraphrasing, tokenization, and recasing

StatMT '08 Proceedings of the Third Workshop on Statistical Machine Translation
A smorgasbord of features for automatic MT evaluation

StatMT '08 Proceedings of the Third Workshop on Statistical Machine Translation
Findings of the 2009 workshop on statistical machine translation

StatMT '09 Proceedings of the Fourth Workshop on Statistical Machine Translation
Syntax-oriented evaluation measures for machine translation output

StatMT '09 Proceedings of the Fourth Workshop on Statistical Machine Translation
NUS at WMT09: domain adaptation experiments for English-Spanish machine translation of news commentary text

StatMT '09 Proceedings of the Fourth Workshop on Statistical Machine Translation
The back-translation score: automatic MT evaluation at the sentence level without reference translations

ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Improved smoothing for N-gram language models based on ordinary counts

ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Less is more: significance-based N-gram selection for smaller, better language models

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
Learning finite state transducers using bilingual phrases

CICLing'08 Proceedings of the 9th international conference on Computational linguistics and intelligent text processing
Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation

WMT '10 Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR
Linguistic measures for automatic machine translation evaluation

Machine Translation
MEANT: an inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility via semantic frames

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Structured vs. flat semantic role representations for machine translation evaluation

SSST-5 Proceedings of the Fifth Workshop on Syntax, Semantics and Structure in Statistical Translation
Matxin, an open-source rule-based machine translation system for Basque

Machine Translation
An active learning scenario for interactive machine translation

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Findings of the 2011 Workshop on Statistical Machine Translation

WMT '11 Proceedings of the Sixth Workshop on Statistical Machine Translation
Active learning for interactive machine translation

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Improving machine translation of null subjects in Italian and Spanish

EACL '12 Proceedings of the Student Research Workshop at the 13th Conference of the European Chapter of the Association for Computational Linguistics
Tree-based hybrid machine translation

EACL 2012 Proceedings of the Joint Workshop on Exploiting Synergies between Information Retrieval and Machine Translation (ESIRMT) and Hybrid Approaches to Machine Translation (HyTra)
Towards a predicate-argument evaluation for MT

SSST-6 '12 Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation
Unsupervised vs. supervised weight estimation for semantic MT evaluation metrics

SSST-6 '12 Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation
Findings of the 2012 workshop on statistical machine translation

WMT '12 Proceedings of the Seventh Workshop on Statistical Machine Translation
Fully automatic semantic MT evaluation

WMT '12 Proceedings of the Seventh Workshop on Statistical Machine Translation
Training speech translation from audio recordings of interpreter-mediated communication

Computer Speech and Language
Quality estimation for machine translation: some lessons learned

Machine Translation
Cost-sensitive active learning for computer-assisted translation

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

We evaluated machine translation performance for six European language pairs that participated in a shared task: translating French, German, Spanish texts to English and back. Evaluation was done automatically using the Bleu score and manually on fluency and adequacy.