A multi-perspective evaluation of the NESPOLE!: speech-to-speech translation system

  • Authors:
  • Alon Lavie;Florian Metze;Roldano Cattoni;Erica Costantini

  • Affiliations:
  • Carnegie Mellon University, Pittsburgh, PA;University of Karlsruhe, Germany;ITC-irst, Trento, Italy;University of Trieste, Trieste, Italy

  • Venue:
  • S2S '02 Proceedings of the ACL-02 workshop on Speech-to-speech translation: algorithms and systems - Volume 7
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Performance and usability of real-world speech-to-speech translation systems, like the one developed within the NESPOLE! project, are affected by several aspects that go beyond the pure translation quality provided by the underlying components of the system. In this paper we describe these aspects as perspectives along which we have evaluated the NESPOLE! system. Four main issues are investigated: (1) assessing system performance under various network traffic conditions; (2) a study on the usage and utility of multi-modality in the context of multi-lingual communication; (3) a comparison of the features of the individual speech recognition engines, and (4) an end-to-end evaluation of the system.