A dependency-based method for evaluating broad-coverage parsers
Natural Language Engineering
Edit detection and parsing for transcribed speech
NAACL '01 Proceedings of the second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies
Online large-margin training of dependency parsers
ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Recognising textual entailment with logical inference
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
The second release of the RASP system
COLING-ACL '06 Proceedings of the COLING/ACL on Interactive presentation sessions
Evaluating the accuracy of an unlexicalized statistical parser on the PARC DepBank
COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Wide-coverage efficient statistical parsing with ccg and log-linear models
Computational Linguistics
Early deletion of fillers in processing conversational speech
NAACL-Short '06 Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers
High-accuracy annotation and parsing of CHILDES transcripts
CACLA '07 Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition
CACLA '07 Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition
Semantic interpretation of Dutch spoken dialogue
IWCS-8 '09 Proceedings of the Eighth International Conference on Computational Semantics
| Hi-index | 0.00 |
This paper discusses the performance difference of wide-coverage parsers on small-domain speech transcripts. Two parsers (C&C CCG and RASP) are tested on the speech transcripts of two different domains (parent-child language, and picture descriptions). The performance difference between the domain-independent parsers and two domain-trained parsers (MSTParser and MEGRASP) is substantial, with a difference of at least 30 percent point in accuracy. Despite this gap, some of the grammatical relations can still be recovered reliably.