Designing a task-based evaluation methodology for a spoken machine translation system

Authors:
Kavita Thomas
Affiliations:
Carnegie Mellon University, Pittsburgh, PA
Venue:
ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
Year:
1999

Citing 4
Cited 1

Beyond class A: a proposal for automatic evaluation of discourse

HLT '90 Proceedings of the workshop on Speech and Natural Language
End-to-End Evaluation in JANUS: A Speech-to-speech Translation System

ECAI '96 Workshop on Dialogue Processing in Spoken Language Systems
Experiments in evaluating interactive spoken language systems

HLT '91 Proceedings of the workshop on Speech and Natural Language
Human-machine problem solving using spoken language systems (SLS): factors affecting performance and user satisfaction

HLT '91 Proceedings of the workshop on Speech and Natural Language

The Janus-III Translation System: Speech-to-Speech Translation in Multiple Domains

Machine Translation

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, I discuss issues pertinent to the design of a task-based evaluation methodology for a spoken machine translation (MT) system processing human to human communication rather than human to machine communication. I claim that system mediated human to human communication requires new evaluation criteria and metrics based on goal complexity and the speaker's prioritization of goals.