Goal-directed requirements acquisition
6IWSSD Selected Papers of the Sixth International Workshop on Software Specification and Design
From object-oriented to goal-oriented requirements analysis
Communications of the ACM
Agent Autonomy
Goal-Oriented Requirements Engineering: A Guided Tour
RE '01 Proceedings of the Fifth IEEE International Symposium on Requirements Engineering
Tropos: An Agent-Oriented Software Development Methodology
Autonomous Agents and Multi-Agent Systems
SEAGENT: a platform for developing semantic web based multi agent systems
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Specification and testing of autonomous agents in e-commerce systems: Research Articles
Software Testing, Verification & Reliability
Unit testing in multi-agent systems using mock agents and aspects
Proceedings of the 2006 international workshop on Software engineering for large-scale multi-agent systems
Environment as a first class abstraction in multiagent systems
Autonomous Agents and Multi-Agent Systems
The Current State and Future of Search Based Software Engineering
FOSE '07 2007 Future of Software Engineering
Evolutionary functional testing
Computers and Operations Research
Multi-objective Improvement of Software Using Co-evolution and Smart Seeding
SEAL '08 Proceedings of the 7th International Conference on Simulated Evolution and Learning
Evolutionary testing of autonomous software agents
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Decision-making in an embedded reasoning system
IJCAI'89 Proceedings of the 11th international joint conference on Artificial intelligence - Volume 2
The state problem for evolutionary testing
GECCO'03 Proceedings of the 2003 international conference on Genetic and evolutionary computation: PartII
SUnit: a unit testing framework for test driven development of multi-agent systems
AOSE'06 Proceedings of the 7th international conference on Agent-oriented software engineering VII
Debugging agent behavior in an implemented agent system
ProMAS'04 Proceedings of the Second international conference on Programming Multi-Agent Systems
A qualitative survey of regression testing practices
PROFES'10 Proceedings of the 11th international conference on Product-Focused Software Process Improvement
Evolutionary testing techniques
SAGA'05 Proceedings of the Third international conference on StochasticAlgorithms: foundations and applications
A fast and elitist multiobjective genetic algorithm: NSGA-II
IEEE Transactions on Evolutionary Computation
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Hi-index | 0.00 |
A system built in terms of autonomous software agents may require even greater correctness assurance than one that is merely reacting to the immediate control of its users. Agents make substantial decisions for themselves, so thorough testing is an important consideration. However, autonomy also makes testing harder; by their nature, autonomous agents may react in different ways to the same inputs over time, because, for instance they have changeable goals and knowledge. For this reason, we argue that testing of autonomous agents requires a procedure that caters for a wide range of test case contexts, and that can search for the most demanding of these test cases, even when they are not apparent to the agents' developers. In this paper, we address this problem, introducing and evaluating an approach to testing autonomous agents that uses evolutionary optimisation to generate demanding test cases. We propose a methodology to derive objective (fitness) functions that drive evolutionary algorithms, and evaluate the overall approach with two simulated autonomous agents. The obtained results show that our approach is effective in finding good test cases automatically.