An automatic evaluation method for localization oriented lexicalised EBMT system

Authors:
Jianmin Yao;Ming Zhou;Tiejun Zhao;Hao Yu;Sheng Li
Affiliations:
Harbin Institute of Technology, Harbin, China;Microsoft Research Asia, Beijing, China;Harbin Institute of Technology, Harbin, China;Harbin Institute of Technology, Harbin, China;Harbin Institute of Technology, Harbin, China
Venue:
COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Year:
2002

Citing 5
Cited 0

Foundations of statistical natural language processing

Foundations of statistical natural language processing
The String-to-String Correction Problem

Journal of the ACM (JACM)
Toward a scoring function for quality-driven machine translation

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Automatic evaluation of computer generated text: a progress report on the TextEval project

HLT '94 Proceedings of the workshop on Human Language Technology
Language and Machines: Computers in Translation and Linguistics

Language and Machines: Computers in Translation and Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

To help developing a localization oriented EBMT system, an automatic machine translation evaluation method is implemented which adopts edit distance, cosine correlation and Dice coefficient as criteria. Experiment shows that the evaluation method distinguishes well between "good" translations and "bad" ones. To prove that the method is consistent with human evaluation, 6 MT systems are scored and compared. Theoretical analysis is made to validate the experimental results. Correlation coefficient and significance tests at 0.01 level are made to ensure the reliability of the results. Linear regression equations are calculated to map the automatic scoring results to human scorings.