Evaluating the performance of the survey parser with the NIST scheme

Authors:
Alex Chengyu Fang
Affiliations:
Department of Chinese, Translation and Linguistics, City University of Hong Kong, Kowloon, Hong Kong
Venue:
CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
Year:
2006

Citing 4
Cited 1

Measurements in support of research accomplishments

Communications of the ACM
A maximum-entropy-inspired parser

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
A dependency-based method for evaluating broad-coverage parsers

Natural Language Engineering
Accurate unlexicalized parsing

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1

Adapting NLP and corpus analysis techniques to structured imagery analysis in classical Chinese poetry

AdaptLRTtoND '09 Proceedings of the Workshop on Adaptation of Language Resources and Technology to New Domains

Quantified Score

Hi-index	0.00

Visualization

Abstract

Different metrics have been proposed for the estimation of how good a parser-produced syntactic tree is when judged by a correct tree from the treebank. The emphasis of measurement has been on the number of correct constituents in terms of constituent labels and bracketing accuracy. This article proposes the use of the NIST scheme as a better alternative for the evaluation of parser output in terms of correct match, substitution, deletion, and insertion. It describes an experiment to measure the performance of the Survey Parser that was used to complete the syntactic annotation of the International Corpus of English. This article will finally report empirical scores for the performance of the parser and outline some future research.