Automatic creation of an autonomous agent: genetic evolution of a neural-network driven robot
SAB94 Proceedings of the third international conference on Simulation of adaptive behavior : from animals to animats 3: from animals to animats 3
Evolving mobile robots in simulated and real environments
Artificial Life
Online Interactive Neuro-evolution
Neural Processing Letters
Neural Networks: A Comprehensive Foundation
Neural Networks: A Comprehensive Foundation
Coordination and Learning in Multirobot Systems
IEEE Intelligent Systems
Cellular Encoding Applied to Neurocontrol
Proceedings of the 6th International Conference on Genetic Algorithms
Solving Non-Markovian Control Tasks with Neuro-Evolution
IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Collective Intelligence and Braess' Paradox
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Efficient Reinforcement Learning Through Evolving Neural Network Topologies
GECCO '02 Proceedings of the Genetic and Evolutionary Computation Conference
Advances in evolutionary computing
Ant Colony Optimization
Collectives and Design Complex Systems
Collectives and Design Complex Systems
Unifying Temporal and Structural Credit Assignment Problems
AAMAS '04 Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 2
Efficient credit assignment through evaluation function decomposition
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Multi-agent reward analysis for learning in noisy domains
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents
Evolutionary Computation
Distributed evaluation functions for fault tolerant multi-rover systems
Proceedings of the 8th annual conference on Genetic and evolutionary computation
Active guidance for a finless rocket using neuroevolution
GECCO'03 Proceedings of the 2003 international conference on Genetic and evolutionary computation: PartII
Efficient reward functions for adaptive multi-rover systems
LAMAS'05 Proceedings of the First international conference on Learning and Adaption in Multi-Agent Systems
Biasing Coevolutionary Search for Optimal Multiagent Behaviors
IEEE Transactions on Evolutionary Computation
Adaptively Coordinating Heterogeneous Robot Teams through Asynchronous Situated Coevolution
ICONIP '09 Proceedings of the 16th International Conference on Neural Information Processing: Part II
Information Sciences: an International Journal
Coevolution of heterogeneous multi-robot teams
Proceedings of the 12th annual conference on Genetic and evolutionary computation
A neuro-evolutionary approach to micro aerial vehicle control
Proceedings of the 12th annual conference on Genetic and evolutionary computation
Robust neuro-control for a micro quadrotor
Proceedings of the 12th annual conference on Genetic and evolutionary computation
Robot coordination with ad-hoc team formation
Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
Self-organizing robot teams using asynchronous situated co-evolution
SAB'10 Proceedings of the 11th international conference on Simulation of adaptive behavior: from animals to animats
Open-ended evolution as a means to self-organize heterogeneous multi-robot systems in real time
Robotics and Autonomous Systems
Social learning for collaboration through ASiCo based neuroevolution
Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology - Evolutionary neural networks for practical applications
Adaptive navigation for autonomous robots
Robotics and Autonomous Systems
Agent fitness functions for evolving coordinated sensor networks
Proceedings of the 13th annual conference on Genetic and evolutionary computation
Optimizing ballast design of wave energy converters using evolutionary algorithms
Proceedings of the 13th annual conference on Genetic and evolutionary computation
Task-driven species in evolutionary robotic teams
IWINAC'11 Proceedings of the 4th international conference on Interplay between natural and artificial computation - Volume Part I
ECAL'09 Proceedings of the 10th European conference on Advances in artificial life: Darwin meets von Neumann - Volume Part II
Coordinating learning agents for multiple resource job scheduling
ALA'09 Proceedings of the Second international conference on Adaptive and Learning Agents
Self-organization and specialization in multiagent systems through open-ended natural evolution
EvoApplications'12 Proceedings of the 2012t European conference on Applications of Evolutionary Computation
Policy transfer in mobile robots using neuro-evolutionary navigation
Proceedings of the 14th annual conference companion on Genetic and evolutionary computation
Shaping fitness functions for coevolving cooperative multiagent systems
Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Hi-index | 0.00 |
This paper presents fitness evaluation functions that efficiently evolve coordination in large multi-component systems. In particular, we focus on evolving distributed control policies that are applicable to dynamic and stochastic environments. While it is appealing to evolve such policies directly for an entire system, the search space is prohibitively large in most cases to allow such an approach to provide satisfactory results. Instead, we present an approach based on evolving system components individually where each component aims to maximize its own fitness function. Though this approach sidesteps the exploding state space concern, it introduces two new issues: (1) how to create component evaluation functions that are aligned with the global evaluation function; and (2) how to create component evaluation functions that are sensitive to the fitness changes of that component, while remaining relatively insensitive to the fitness changes of other components in the system. If the first issue is not addressed, the resulting system becomes uncoordinated; if the second issue is not addressed, the evolutionary process becomes either slow to converge or worse, incapable of converging to good solutions. This paper shows how to construct evaluation functions that promote coordination by satisfying these two properties. We apply these evaluation functions to the distributed control problem of coordinating multiple rovers to maximize aggregate information collected. We focus on environments that are highly dynamic (changing points of interest), noisy (sensor and actuator faults), and communication limited (both for observation of other rovers and points of interest) forcing the rovers to evolve generalized solutions. On this difficult coordination problem, the control policy evolved using aligned and component-sensitive evaluation functions outperforms global evaluation functions by up to 400%. More notably, the performance improvements increase when the problems become more difficult (larger, noisier, less communication). In addition we provide an analysis of the results by quantifying the two characteristics (alignment and sensitivity discussed above) leading to a systematic study of the presented fitness functions.