Context-dependent regression testing for natural language processing

Authors:
Elaine Farrow;Myroslava O. Dzikovska
Affiliations:
University of Edinburgh, Edinburgh, UK;University of Edinburgh, Edinburgh, UK
Venue:
SETQA-NLP '09 Proceedings of the Workshop on Software Engineering, Testing, and Quality Assurance for Natural Language Processing
Year:
2009

Citing 3
Cited 0

Deep linguistic processing for spoken dialogue systems

DeepLP '07 Proceedings of the Workshop on Deep Linguistic Processing
Designing testsuites for grammar-based systems in applications

GEAF '08 Proceedings of the Workshop on Grammar Engineering Across Frameworks
Interpretation and generation in a knowledge-based tutorial system

KRAQ '06 Proceedings of the Workshop KRAQ'06 on Knowledge and Reasoning for Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Regression testing of natural language systems is problematic for two main reasons: component input and output is complex, and system behaviour is context-dependent. We have developed a generic approach which solves both of these issues. We describe our regression tool, Contest, which supports context-dependent testing of dialogue system components, and discuss the regression test sets we developed, designed to effectively isolate components from changes and problems earlier in the pipeline. We believe that the same approach can be used in regression testing for other dialogue systems, as well as in testing any complex NLP system containing multiple components.