The Power of the TSNLP: Lessons from a Diagnostic Evaluation of a Broad-Coverage Parser

Authors:
Elizabeth Scarlett;Stan Szpakowicz
Affiliations:
-;-
Venue:
AI '00 Proceedings of the 13th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence
Year:
2000

Citing 5
Cited 0

Test-Driving TANKA: Evaluating a Semi-automatic System of Text Analysis for Knowledge Acquisition

AI '98 Proceedings of the 12th Biennial Conference of the Canadian Society for Computational Studies of Intelligence on Advances in Artificial Intelligence
Text processing without a priori domain knowledge: semi-automatic linguistic analysis for incremental knowledge acquisition

Text processing without a priori domain knowledge: semi-automatic linguistic analysis for incremental knowledge acquisition
Systematic construction of a versatile case system

Natural Language Engineering
TSNLP: Test Suites for Natural Language Processing

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
Language As a Cognitive Process: Syntax

Language As a Cognitive Process: Syntax

Quantified Score

Hi-index	0.00

Visualization

Abstract

We show a diagnostic evaluation of DIPETT, a broad-coverage parser of English sentences. We consider the TSNLP suite as a diagnostic tool, and propose an alternative broader-coverage test suite of test sentences extracted from Quirk et al. We compare the diagnostic effectiveness of the two suites, and draw a few general conclusions. The evaluation results were used to make significant improvements to DIPETT.