Usability inspection methods
ELIZA—a computer program for the study of natural language communication between man and machine
Communications of the ACM
Human-computer interaction in the new millennium
Human-computer interaction in the new millennium
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
Towards developing general models of usability with PARADISE
Natural Language Engineering
The PARADISE Evaluation Framework: Issues and Findings
Computational Linguistics
PLOW: a collaborative task learning agent
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
An evaluation understudy for dialogue coherence models
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Hi-index | 0.00 |
We propose a new approach toward evaluation of spoken dialog systems. The novelty of our method is based on utilization of domain-specific knowledge combined with the deterministic measurement of dialog system performance on a set of individual tasks within the domain. The proposed methodology thus attempts to answer questions such as: "How well is my dialog system performing on a specific domain?", "How much has my dialog system improved since the previous version?", "How much is my dialog system better/worse than other dialog systems performing on that domain?"