The Power of the TSNLP: Lessons from a Diagnostic Evaluation of a Broad-Coverage Parser
AI '00 Proceedings of the 13th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence
Improving testsuites via instrumentation
ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Natural language dialogue service for appointment scheduling agents
ANLC '97 Proceedings of the fifth conference on Applied natural language processing
An annotation scheme for free word order languages
ANLC '97 Proceedings of the fifth conference on Applied natural language processing
The use of instrumentation in grammar engineering
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Integrating shallow linguistic processing into a unification: based Spanish grammar
COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
A classification of grammar development strategies
COLING-GEE '02 Proceedings of the 2002 workshop on Grammar engineering and evaluation - Volume 15
COLING '08 22nd International Conference on on Computational Linguistics: Demonstration Papers
Parser evaluation across frameworks without format conversion
CrossParser '08 Coling 2008: Proceedings of the workshop on Cross-Framework and Cross-Domain Parser Evaluation
TuLiPA: towards a multi-formalism parsing environment for grammar engineering
GEAF '08 Proceedings of the Workshop on Grammar Engineering Across Frameworks
From grammar-independent construction enumeration to lexical types in computational grammars
GEAF '08 Proceedings of the Workshop on Grammar Engineering Across Frameworks
Designing testsuites for grammar-based systems in applications
GEAF '08 Proceedings of the Workshop on Grammar Engineering Across Frameworks
Using large-scale parser output to guide grammar development
GEAF '09 Proceedings of the 2009 Workshop on Grammar Engineering Across Frameworks
Dependency constraints for lexical disambiguation
IWPT '09 Proceedings of the 11th International Conference on Parsing Technologies
Learning for deep language understanding
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Multimodal grammar implementation
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Efficient large-scale parsing: a survey
Proceedings of the COLING-2000 Workshop on Efficiency In Large-Scale Parsing Systems
| Hi-index | 0.00 |
The growing language technology industry needs measurement tools to allow researchers, engineers, managers, and customers to track development, evaluate and assure quality, and assess suitability for a variety of applications.The TSNLP (Test Suites for Natural Language Processing) project has investigated various aspects of the construction, maintenance and application of systematic test suites as diagnostic and evaluation tools for NLP applications. The paper summarizes the motivation and main results of TSNLP: besides the solid methodological foundation of the project, TSNLP has produced substantial (i.e. larger than any existing general test suites) multi-purpose and multi-user test suites for three European languages together with a set of specialized tools that facilitate the construction, extension, maintenance, retrieval, and customization of the test data.The publicly available results of TSNLP represent a valuable linguistic resource that has the potential of providing a wide-spread pre-standard diagnostic and evaluation tool for both developers and users of NLP applications.