Introduction to algorithms
Artificial intelligence: a modern approach
Artificial intelligence: a modern approach
Assessing agreement on classification tasks: the kappa statistic
Computational Linguistics
An architecture for more realistic conversational systems
Proceedings of the 6th international conference on Intelligent user interfaces
Towards developing general models of usability with PARADISE
Natural Language Engineering
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Automatic detection of poor speech recognition at the dialogue level
ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
Annotating semantic consistency of speech recognition hypotheses
SIGDIAL '02 Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2
CASIS: a context-aware speech interface system
Proceedings of the 10th international conference on Intelligent user interfaces
Automatic creation of interface specifications from ontologies
SEALTS '03 Proceedings of the HLT-NAACL 2003 workshop on Software engineering and architecture of language technology systems - Volume 8
Less is more: using a single knowledge representation in dialogue systems
HLT-NAACL-TEXTMEANING '03 Proceedings of the HLT-NAACL 2003 workshop on Text meaning - Volume 9
Scaling natural language understanding via user-driven ontology learning
ScaNaLU '06 Proceedings of the Third Workshop on Scalable Natural Language Understanding
A graph-theoretic framework for semantic distance
Computational Linguistics
Towards a method for evaluating naturalness in conversational dialog systems
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Contextual coherence in natural language processing
CONTEXT'03 Proceedings of the 4th international and interdisciplinary conference on Modeling and using context
Ontology population and enrichment: state of the art
Knowledge-driven multimedia information extraction and ontology evolution
Cognitive canonicalization of natural language queries using semantic strata
ACM Transactions on Speech and Language Processing (TSLP)
| Hi-index | 0.00 |
In this paper we present ONTOSCORE, a system for scoring sets of concepts on the basis of an ontology. We apply our system to the task of scoring alternative speech recognition hypotheses (SRH) in terms of their semantic coherence. We conducted an annotation experiment and showed that human annotators can reliably differentiate between semantically coherent and incoherent speech recognition hypotheses. An evaluation of our system against the annotated data shows that, it successfully classifies 73.2% in a German corpus of 2.284 SRHs as either coherent or incoherent (given a baseline of 54.55%).