Large-scale semantic networks: annotation and evaluation

Authors:
Václav Novák;Sven Hartrumpf;Keith Hall
Affiliations:
Charles University in Prague, Czech Republic;University of Hagen, Germany;Google Research, Zürich, Switzerland
Venue:
DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
Year:
2009

Citing 4
Cited 0

The Wiki way: quick collaboration on the Web

The Wiki way: quick collaboration on the Web
Building a large annotated corpus of English: the penn treebank

Computational Linguistics - Special issue on using large corpora: II
Knowledge Representation and the Semantics of Natural Language (Cognitive Technologies)

Knowledge Representation and the Semantics of Natural Language (Cognitive Technologies)
Cedit: semantic networks manual annotation tool

NAACL-Demonstrations '07 Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce a large-scale semantic-network annotation effort based on the MutliNet formalism. Annotation is achieved via a process which incorporates several independent tools including a MultiNet graph editing tool, a semantic concept lexicon, a user-editable knowledge-base for semantic concepts, and a MultiNet parser. We present an evaluation metric for these semantic networks, allowing us to determine the quality of annotations in terms of inter-annotator agreement. We use this metric to report the agreement rates for a pilot annotation effort involving three annotators.