Towards best practice in the development and evaluation of speech recognition components of a spoken language dialog system

Authors:
Lori Lamel;Wolfgang Minker;Patrick Paroubek
Affiliations:
Spoken Language Processing Group, LIMSI-CNRS, BP 133, 91403 Orsay cedex, France/ e-mail: lamel@limsi.fr, minker@gmx.de, pap@limsi.fr, minker@gmx.de;Spoken Language Processing Group, LIMSI-CNRS, BP 133, 91403 Orsay cedex, France/ e-mail: lamel@limsi.fr, minker@gmx.de, pap@limsi.fr, minker@gmx.de;Spoken Language Processing Group, LIMSI-CNRS, BP 133, 91403 Orsay cedex, France/ e-mail: lamel@limsi.fr, minker@gmx.de, pap@limsi.fr, minker@gmx.de
Venue:
Natural Language Engineering
Year:
2000

Citing 9
Cited 1

Software design and development

Software design and development
Evaluation of spoken language systems: the ATIS domain

HLT '90 Proceedings of the workshop on Speech and Natural Language
Evaluating Natural Language Processing Systems: An Analysis and Review

Evaluating Natural Language Processing Systems: An Analysis and Review
Designing Interactive Speech Systems: From First Ideas to User Testing

Designing Interactive Speech Systems: From First Ideas to User Testing
Interactive Translation of Conversational Speech

Computer
Model Compensation for Noises in Training and Test Data

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2 - Volume 2
Recognition of Conversational Telephone Speech using the Janus Speech Engine

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 3 - Volume 3
Large-vocabulary speaker-independent continuous speech recognition: the sphinx system

Large-vocabulary speaker-independent continuous speech recognition: the sphinx system
The LIMSI ARISE system for train travel information

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 01

Toward evaluation that leads to best practices: reconciling dialog evaluation in research and industry

NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article provides a global overview of the main aspects of current practice in the design, implementation and evaluation of speech recognition components for Spoken Language Dialog Systems (SLDSs), and presents the results of the DISC European project related to speech recognition. DISC and its successor DISC-2 are efforts towards the definition of best practice guidelines for SLDS development and evaluation. SLDSs aim at using natural spoken input for performing an information processing task such as automated standards, call routing or travel planning and reservations. The main functionality of an SLDS are speech recognition, natural language understanding, dialog management, database access and interpretation, response generation and speech synthesis. Speech recognition, which transforms the acoustic signal into a string of words, is a key technology in any SLDS.