Expert systems: artificial intelligence in business
Expert systems: artificial intelligence in business
Automatic verification of finite-state concurrent systems using temporal logic specifications
ACM Transactions on Programming Languages and Systems (TOPLAS)
Artificial Intelligence
Expert systems: perils and promise
Communications of the ACM
AI Magazine
An Evaluation of Expert Systems for Software Engineering Management
IEEE Transactions on Software Engineering
Partition Testing Does Not Inspire Confidence (Program Testing)
IEEE Transactions on Software Engineering
Verifying knowledge bases by anomaly detection: an experience report
ECAI '92 Proceedings of the 10th European conference on Artificial intelligence
An empirical evaluation (and specification) of the all-du-paths testing criterion
Software Engineering Journal
Experimental results on the application of satisfiability algorithms to scheduling problems
AAAI'94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 2)
Principles for generalised testing of knowledge bases
Principles for generalised testing of knowledge bases
Software testing and reliability
Handbook of software reliability engineering
Representation of propositional expert systems as partial functions
Artificial Intelligence
Knowledge-based systems' validation: when to stop running test cases
International Journal of Human-Computer Studies
Reliability Testing of Rule-Based Systems
IEEE Software
An Experimental Comparison of the Effectiveness of Branch Testing and Data Flow Testing
IEEE Transactions on Software Engineering
Evaluating a Qualitative Reasoner
AI '97 Proceedings of the 10th Australian Joint Conference on Artificial Intelligence: Advanced Topics in Artificial Intelligence
On the Practicality of Viewpoint-Based Requirements Engineering
PRICAI '98 Proceedings of the 5th Pacific Rim International Conference on Artificial Intelligence: Topics in Artificial Intelligence
A model-based approach to reactive self-configuring systems
AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 2
IEEE Software
FAABS '00 Proceedings of the First International Workshop on Formal Approaches to Agent-Based Systems-Revised Papers
Hi-index | 0.01 |
Knowledge-based engineering and computational intelligence are expected to become core technologies in the design and manufacturing for the next generation of space exploration missions. Yet, if one is concerned with the reliability of knowledge based systems, studies indicate significant disagreement regarding the amount of testing needed for system assessment. The sizes of standard black-box test suites are impracticably large since the black-box approach neglects the internal structure of knowledge-based systems. On the contrary, practical results repeatedly indicate that only a few tests are needed to sample the range of behaviors of a knowledge-based program. In this paper, we model testing as a search process over the internal state space of the knowledge-based system. When comparing different test suites, the test suite that examines larger portion of the state space is considered more complete. Our goal is to investigate the trade-off between the completeness criterion and the size of test suites. The results of testing experiment on tens of thousands of mutants of real-world knowledge based systems indicate that a very limited gain in completeness can be achieved through prolonged testing. The use of simple (or random) search strategies for testing appears to be as powerful as testing by more thorough search algorithms.