Edit distances with block movements and error rate confidence estimates

Authors:
Gregor Leusch;Hermann Ney
Affiliations:
Computer Science Department, RWTH Aachen University, Aachen, Germany 52056;Computer Science Department, RWTH Aachen University, Aachen, Germany 52056
Venue:
Machine Translation
Year:
2009

Citing 5
Cited 3

The Stanford GraphBase: a platform for combinatorial computing

The Stanford GraphBase: a platform for combinatorial computing
Block edit models for approximate string matching

Theoretical Computer Science - Special issue: Latin American theoretical informatics
An algorithm for simultaneously bracketing parallel texts by aligning words

ACL '95 Proceedings of the 33rd annual meeting on Association for Computational Linguistics
ORANGE: a method for evaluating automatic evaluation metrics for machine translation

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Machine translation system combination using ITG-based alignments

HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers

Findings of the 2011 Workshop on Statistical Machine Translation

WMT '11 Proceedings of the Sixth Workshop on Statistical Machine Translation
Lightly-supervised training for hierarchical phrase-based machine translation

EMNLP '11 Proceedings of the First Workshop on Unsupervised Learning in NLP
Jane: an advanced freely available hierarchical machine translation toolkit

Machine Translation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present two evaluation measures for Machine Translation (MT), which are defined as error rates extended by block moves. In contrast to Ter, these measures are constrained in a way that allows for an exact calculation in polynomial time. We then investigate three methods to estimate the standard error of error rates, and compare them to bootstrap estimates. We assess the correlation of our proposed measures with human judgment using data from the National Institute of Standards and Technology (NIST) 2008 MetricsMATR workshop.