Annotating semantic consistency of speech recognition hypotheses

Authors:
Iryna Gurevych;Robert Porzel;Michael Strube
Affiliations:
European Media Laboratory GmbH, Heidelberg, Germany;European Media Laboratory GmbH, Heidelberg, Germany;European Media Laboratory GmbH, Heidelberg, Germany
Venue:
SIGDIAL '02 Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2
Year:
2002

Citing 2
Cited 2

Assessing agreement on classification tasks: the kappa statistic

Computational Linguistics
Annotating anaphoric and bridging relations with MMAX

SIGDIAL '01 Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - Volume 16

Semantic coherence scoring using an ontology

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Less is more: using a single knowledge representation in dialogue systems

HLT-NAACL-TEXTMEANING '03 Proceedings of the HLT-NAACL 2003 workshop on Text meaning - Volume 9

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recent work on natural language processing systems is aimed at more conversational, context-adaptive systems in multiple domains. An important requirement for such a system is the automatic detection of the domain and a domain consistency check of the given speech recognition hypotheses. We report a pilot study addressing these tasks, the underlying data collection and investigate the feasibility of annotating the data reliably by human annotators.