Evaluating the performance of the OntoSem semantic analyzer

Authors:
Sergei Nirenburg;Stephen Beale;Marjorie McShane
Affiliations:
University of Maryland, Baltimore County, Baltimore, MD;University of Maryland, Baltimore County, Baltimore, MD;University of Maryland, Baltimore County, Baltimore, MD
Venue:
TextMean '04 Proceedings of the 2nd Workshop on Text Meaning and Interpretation
Year:
2004

Citing 2
Cited 5

Automatic labeling of semantic roles

Computational Linguistics
Operative strategies in ontological semantics

HLT-NAACL-TEXTMEANING '03 Proceedings of the HLT-NAACL 2003 workshop on Text meaning - Volume 9

OntoSem methods for processing semantic ellipsis

CLS '04 Proceedings of the HLT-NAACL Workshop on Computational Lexical Semantics
Semantically rich human-aided machine annotation

CorpusAnno '05 Proceedings of the Workshop on Frontiers in Corpus Annotations II: Pie in the Sky
Baseline evaluation of WSD and semantic dependency in OntoSem

STEP '08 Proceedings of the 2008 Conference on Semantics in Text Processing
OntoSem and SIMPLE: two multi-lingual world views

TextMean '04 Proceedings of the 2nd Workshop on Text Meaning and Interpretation
Question answering using ontological semantics

TextMean '04 Proceedings of the 2nd Workshop on Text Meaning and Interpretation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an innovative evaluation regimen developed for the text meaning representations (TMRs) produced by the Ontological Semantic (OntoSem) general purpose syntactic-semantic analyzer. The goal of evaluation is not only to determine the quality of TMRs for given texts, but also to assign blame for various classes of errors, thus suggesting directions for continued work on both knowledge resources and processors. The paper includes descriptions of the OntoSem processing environment, the evaluation regime itself and results from our first evaluation effort.