Principles of artificial intelligence
Principles of artificial intelligence
Validation, verification and test of knowledge-based systems
Validation, verification and test of knowledge-based systems
The engineering of knowledge-based systems: theory and practice
The engineering of knowledge-based systems: theory and practice
Inductive learning for abductive diagnosis
AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Turbine engine diagnostics (TED): an expert diagnostic system for the M1 Abrams turbine engine
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Extreme programming explained: embrace change
Extreme programming explained: embrace change
Ordered binary decision diagrams as knowledge-bases
Artificial Intelligence
Knowledge Engineering Vol I: Fundamentals
Knowledge Engineering Vol I: Fundamentals
Verification and Validation of Rule-Based Expert Systems
Verification and Validation of Rule-Based Expert Systems
Machine Learning
Validation and Reparation of Knowledge Bases
ISMIS '02 Proceedings of the 13th International Symposium on Foundations of Intelligent Systems
A quantitative analysis of the robustness of knowledge-based systems through degradation studies
Knowledge and Information Systems
Logical Foundations for Rule-Based Systems (Studies in Computational Intelligence) (Studies in Computational Intelligence)
IEEE Transactions on Computers
On automatic knowledge validation for Bayesian knowledge bases
Data & Knowledge Engineering
Proposal of Business Process and Rules Modeling with the XTT Method
SYNASC '07 Proceedings of the Ninth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing
A generic design environment for the rural industry knowledge acquisition
Knowledge-Based Systems
Development and Verification of Rule Based Systems -- A Survey of Developers
RuleML '08 Proceedings of the International Symposium on Rule Representation, Interchange and Reasoning on the Web
Test case generation using KBS strategy
IJCAI'93 Proceedings of the 13th international joint conference on Artifical intelligence - Volume 1
Anomalies in ontologies with rules
Web Semantics: Science, Services and Agents on the World Wide Web
Gray box robustness testing of rule systems
KI'06 Proceedings of the 29th annual German conference on Artificial intelligence
Automated testing for knowledge based systems
KES'07/WIRN'07 Proceedings of the 11th international conference, KES 2007 and XVII Italian workshop on neural networks conference on Knowledge-based intelligent information and engineering systems: Part I
Experience management: foundations, development methodology, and internet-based applications
Experience management: foundations, development methodology, and internet-based applications
Declaratively querying and visualizing knowledge bases in XML
INAP'04/WLP'04 Proceedings of the 15th international conference on Applications of Declarative Programming and Knowledge Management, and 18th international conference on Workshop on Logic Programming
Verification and refactoring of ontologies with rules
EKAW'06 Proceedings of the 15th international conference on Managing Knowledge in a World of Networks
A framework for validation of rule-based systems
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Developing knowledge systems with continuous integration
i-KNOW '11 Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies
Knowledge-based environment to support product design validation
Knowledge-Based Systems
Perceptually grounded self-diagnosis and self-repair of domain knowledge
Knowledge-Based Systems
| Hi-index | 0.00 |
In today's industrial applications, we see that knowledge systems are successfully implemented. However, critical domains require the elaborate and thoughtful validation of the knowledge bases before the deployment. Empirical testing, also known as regression testing, denotes the most popular validation technique, where predefined test cases are used to simulate and review the correct behavior of the system. In this paper, we motivate that the classic notions of a test case and the corresponding measures are not sufficient in many application scenarios. We present enhanced notions generalizing the standard test case, and we show appropriate extensions of the measures precision and recall, that work on these test case notions. Furthermore, the effective inspection of test runs is important whenever test cases fail. We introduce a novel visualization technique that allows for the effective and intuitive analysis of test cases and test run outcomes. The new visualization is useful for debugging a knowledge base and test case, respectively, but it also provides an intuitive overview of the status of the entire test suite. A case study reports on the (repeated) validation of a medical decision-support system and demonstrates the practical relevance of the presented work.