A quantitative analysis of the robustness of knowledge-based systems through degradation studies

Authors:
Perry Groot;Annette ten Teije;Frank van Harmelen
Affiliations:
Vrije Universiteit, Division of Mathematics and Computer Science, Faculty of Sciences, Amsterdam, The Netherlands;Vrije Universiteit, Division of Mathematics and Computer Science, Faculty of Sciences, Amsterdam, The Netherlands;Vrije Universiteit, Division of Mathematics and Computer Science, Faculty of Sciences, Amsterdam, The Netherlands
Venue:
Knowledge and Information Systems
Year:
2005

Citing 0
Cited 3

Towards a suite of quality metrics for KADS-domain knowledge

Expert Systems with Applications: An International Journal
Advanced empirical testing

Knowledge-Based Systems
Automated synthesis of multiple analog circuits using evolutionary computation for redundancy-based fault-tolerance

Applied Soft Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The overall aim of this paper is to provide a general setting for quantitative quality measures of knowledge-based system behaviour that is widely applicable to many knowledge-based systems. We propose a general approach that we call degradation studies: an analysis of how system output changes as a function of degrading system input, such as incomplete or incorrect data or knowledge. To show the feasibility of our approach, we have applied it in a case study. We have taken a large and realistic vegetation-classification system, and have analysed its behaviour under various varieties of incomplete and incorrect input. This case study shows that degradation studies can reveal interesting and surprising properties of the system under study.