Reinforcement learning: a survey
Journal of Artificial Intelligence Research
Adaptivity in agent-based routing for data networks
AGENTS '00 Proceedings of the fourth international conference on Autonomous agents
Ant algorithms for discrete optimization
Artificial Life
ANTS '02 Proceedings of the Third International Workshop on Ant Algorithms
Computer Networks: The International Journal of Computer and Telecommunications Networking
Macrosystems Models of Dynamic Stochastic Networks
Automation and Remote Control
Multi-cast ant colony system for the bus routing problem
Metaheuristics
A swarm intelligent multi-path routing for multimedia traffic over mobile ad hoc networks
Proceedings of the 1st ACM international workshop on Quality of service & security in wireless and mobile networks
Pheromone-aided robust multipath and multipriority routing in wireless MANETs
PE-WASUN '05 Proceedings of the 2nd ACM international workshop on Performance evaluation of wireless ad hoc, sensor, and ubiquitous networks
Cooperative Multi-Agent Learning: The State of the Art
Autonomous Agents and Multi-Agent Systems
A comprehensive review of nature inspired routing algorithms for fixed telecommunication networks
Journal of Systems Architecture: the EUROMICRO Journal - Special issue: Nature-inspired applications and systems
Performance analysis of the AntNet algorithm
Computer Networks: The International Journal of Computer and Telecommunications Networking
Collective-movement teams for cooperative problem solving
Integrated Computer-Aided Engineering - Performance Metrics for Intelligent Systems
A biologically-inspired clustering protocol for wireless sensor networks
Computer Communications
Exploring the interdisciplinary connections of gossip-based systems
ACM SIGOPS Operating Systems Review - Gossip-based computer networking
Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems
A distributed learning algorithm for particle systems
Integrated Computer-Aided Engineering
An adaptive latency mitigation scheme for massively multiuser virtual environments
Journal of Network and Computer Applications
Collective intelligence, data routing and braess' paradox
Journal of Artificial Intelligence Research
AntNet: distributed stigmergetic control for communications networks
Journal of Artificial Intelligence Research
QoS-Aware Congestion Adaptive Routing for streaming multimedia in Mobile Ad hoc Networks
International Journal of Communication Networks and Distributed Systems
A new hybrid ant based routing in Mobile Ad Hoc Networks
AsiaCSN '07 Proceedings of the Fourth IASTED Asian Conference on Communication Systems and Networks
A taxonomy of biologically inspired research in computer networking
Computer Networks: The International Journal of Computer and Telecommunications Networking
Convergence results for ant routing algorithms viastochastic approximation
Proceedings of the 13th ACM international conference on Hybrid systems: computation and control
A theory of profit sharing in dynamic environment
PRICAI'00 Proceedings of the 6th Pacific Rim international conference on Artificial intelligence
QoS swarm state dependent routing for irregular traffic in telecommunication networks
ICC'09 Proceedings of the 2009 IEEE international conference on Communications
Multi-policy optimization in self-organizing systems
SOAR'09 Proceedings of the First international conference on Self-organizing architectures
Journal of Parallel and Distributed Computing
Mobile agent based event discovery in wireless sensor networks
ACOS'06 Proceedings of the 5th WSEAS international conference on Applied computer science
CIS'05 Proceedings of the 2005 international conference on Computational Intelligence and Security - Volume Part I
A framework and model for soft routing: the Markovian termite and other curious creatures
ANTS'06 Proceedings of the 5th international conference on Ant Colony Optimization and Swarm Intelligence
Multi-type ACO for light path protection
LAMAS'05 Proceedings of the First international conference on Learning and Adaption in Multi-Agent Systems
Coverage and activity management of wireless video sensor networks for surveillance applications
International Journal of Sensor Networks
Discrete event modeling of swarm intelligence based routing in network systems
Information Sciences: an International Journal
Convergence results for ant routing algorithms via stochastic approximation
ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Reinforcement learning based routing in wireless mesh networks
Wireless Networks
Hi-index | 0.00 |
We investigate two new distributed routing algorithms for data networks based on simple biological "ants" that explore the network and rapidly learn good routes, using a novel variation of reinforcement learning. These two algorithms are fully adaptive to topology changes and changes in link costs in the network, and have space and computational overheads that are competitive with traditional packet routing algorithms: although they can generate more routing traffic when the rate of failures in a network is low, they perform much better under higher failure rates. Both algorithms are more resilient than traditional algorithms, in the sense that random corruption of routing state has limited impact on the computation of paths. We present convergence theorems for both of our algorithms drawing on the theory of non-stationary and stationary discrete-time Markov chains over the reals. We present an extensive empirical evaluation of our algorithms on a simulator that is widely used in the computer networks community for validating and testing protocols. We present comparative results on data delivery performance, aggregate routing traffic (algorithm overhead), as well as the degree of resilience for our new algorithms and two traditional routing algorithms in current use. We also show that the performance of our algorithms scale well with increase in network size-using a realistic topology.