Multiagent learning using a variable learning rate
Artificial Intelligence
Self-organization through bottom-up coalition formation
AAMAS '03 Proceedings of the second international joint conference on Autonomous agents and multiagent systems
Behavior transfer for value-function-based reinforcement learning
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Agent-organized networks for dynamic team formation
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Learning the task allocation game
AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
Quantitative organizational modeling and design for multi-agent systems
Quantitative organizational modeling and design for multi-agent systems
Infection-based self-configuration in agent societies
Proceedings of the 10th annual conference companion on Genetic and evolutionary computation
Efficient multi-agent reinforcement learning through automated supervision
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
Adapting to Changing Resource Requirements for Coalition Formation in Self-Organized Social Networks
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 02
Meta-level Control of Multiagent Learning in Dynamic Repeated Resource Sharing Problems
PRICAI '08 Proceedings of the 10th Pacific Rim International Conference on Artificial Intelligence: Trends in Artificial Intelligence
Integrating organizational control into multi-agent learning
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Self-organising agent organisations
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
A multiagent reinforcement learning algorithm with non-linear dynamics
Journal of Artificial Intelligence Research
Globally Optimal Multi-agent Reinforcement Learning Parameters in Distributed Task Assignment
WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 02
Using graph analysis to study networks of adaptive agent
Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
Self-organization for coordinating decentralized reinforcement learning
Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
Self-organisation in an agent network via multiagent Q-learning
PKAW'10 Proceedings of the 11th international conference on Knowledge management and acquisition for smart systems and services
Journal of Parallel and Distributed Computing
Cognitive policy learner: biasing winning or losing strategies
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Ensemble methods for reinforcement learning with function approximation
MCS'11 Proceedings of the 10th international conference on Multiple classifier systems
Decentralized approaches for self-adaptation in agent organizations
ACM Transactions on Autonomous and Adaptive Systems (TAAS) - Special section on formal methods in pervasive computing, pervasive adaptation, and self-adaptive systems: Models and algorithms
PRIMA'10 Proceedings of the 13th international conference on Principles and Practice of Multi-Agent Systems
Self-organization in an agent network: A mechanism and a potential application
Decision Support Systems
Enhancing decentralized service discovery through structural self-organization
Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 3
Improving self-organized resource allocation with effective communication
AP2PC'08 Proceedings of the 7th international conference on Agents and Peer-to-Peer Computing
Reorganization of Agent Networks with Reinforcement Learning Based on Communication Delay
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02
Engineering Applications of Artificial Intelligence
Intelligent Decision Technologies
Hi-index | 0.00 |
To cope with large scale, agents are usually organized in a network such that an agent interacts only with its immediate neighbors in the network. Reinforcement learning techniques have been commonly used to optimize agents local policies in such a network because they require little domain knowledge and can be fully distributed. However, all of the previous work assumed the underlying network was fixed throughout the learning process. This assumption was important because the underlying network defines the learning context of each agent. In particular, the set of actions and the state space for each agent is defined in terms of the agent's neighbors. If agents dynamically change the underlying network structure (also called self-organize) during learning, then one needs a mechanism for transferring what agents have learned so far before (in the old network structure) to their new learning context (in the new network structure). In this work we develop a novel self-organization mechanism that not only allows agents to self-organize the underlying network during the learning process, but also uses information from learning to guide the self-organization process. Consequently, our work is the first to study this interaction between learning and self-organization. Our self-organization mechanism uses heuristics to transfer the learned knowledge across the different steps of self-organization. We also present a more restricted version of our mechanism that is computationally less expensive and still achieve good performance. We use a simplified version of the distributed task allocation domain as our case study. Experimental results verify the stability of our approach and show a monotonic improvement in the performance of the learning process due to self-organization.