Evaluating task performance for a unidirectional controlled language medical speech translation system

Authors:
Nikos Chatzichrisafis;Pierrette Bouillon;Manny Rayner;Marianne Santaholma;Marianne Starlander;Beth Ann Hockey
Affiliations:
University of Geneva, Geneva, Switzerland;University of Geneva, Geneva, Switzerland;University of Geneva, Geneva, Switzerland;University of Geneva, Geneva, Switzerland;University of Geneva, Geneva, Switzerland;UCSC, NASA Ames Research Center, Moffett Field, CA
Venue:
MST '06 Proceedings of the Workshop on Medical Speech Translation
Year:
2006

Citing 5
Cited 4

Voice User Interface Design

Voice User Interface Design
An open source environment for compiling typed unification grammars into speech recognisers

EACL '03 Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 2
Putting Linguistics into Speech Recognition: The Regulus Grammar Compiler (Studies in Computational Linguistics (Stanford, Calif.).)

Putting Linguistics into Speech Recognition: The Regulus Grammar Compiler (Studies in Computational Linguistics (Stanford, Calif.).)
Japanese speech understanding using grammar specialization

HLT-Demo '05 Proceedings of HLT/EMNLP on Interactive Demonstrations
The Spoken Language Translator

The Spoken Language Translator

Training Statistical Language Models from Grammar-Generated Data: A Comparative Case-Study

GoTAL '08 Proceedings of the 6th international conference on Advances in Natural Language Processing
Almost flat functional semantics for speech translation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
A bidirectional grammar-based medical speech translator

SLP '07 Proceedings of the Workshop on Grammar-Based Approaches to Spoken Language Processing
Using artificially generated data to evaluate statistical machine translation

GEAF '09 Proceedings of the 2009 Workshop on Grammar Engineering Across Frameworks

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a task-level evaluation of the French to English version of MedSLT, a medium-vocabulary unidirectional controlled language medical speech translation system designed for doctor-patient diagnosis interviews. Our main goal was to establish task performance levels of novice users and compare them to expert users. Tests were carried out on eight medical students with no previous exposure to the system, with each student using the system for a total of three sessions. By the end of the third session, all the students were able to use the system confidently, with an average task completion time of about 4 minutes.