Error return plots

Authors:
Ron Artstein
Affiliations:
University of Southern California, Playa Vista, CA
Venue:
SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Year:
2011

Citing 4
Cited 0

Information Retrieval

Information Retrieval
Semi-formal Evaluation of Conversational Characters

Languages: From Formal to Natural
Ada and grace: toward realistic and engaging virtual museum guides

IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Dealing with out of domain questions in virtual characters

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents

Quantified Score

Hi-index	0.00

Visualization

Abstract

Error-return plots show the rate of error (misunderstanding) against the rate of non-return (non-understanding) for Natural Language Processing systems. They are a useful visual tool for judging system performance when other measures such as recall/precision and detection-error tradeoff are less informative, specifically when a system is judged on the correctness of its responses, but may elect to not return a response.