Decentralized learning in wireless sensor networks

Authors:
Mihail Mihaylov;Karl Tuyls;Ann Nowé
Affiliations:
Vrije Universiteit Brussel, Brussels, Belgium;Maastricht University, Maastricht, The Netherlands;Vrije Universiteit Brussel, Brussels, Belgium
Venue:
ALA'09 Proceedings of the Second international conference on Adaptive and Learning Agents
Year:
2009

Citing 10
Cited 3

An adaptive energy-efficient MAC protocol for wireless sensor networks

Proceedings of the 1st international conference on Embedded networked sensor systems
An Evolutionary Dynamical Analysis of Multi-Agent Learning in Iterated Games

Autonomous Agents and Multi-Agent Systems
An adaptive coordinated medium access control for wireless sensor networks

ISCC '04 Proceedings of the Ninth International Symposium on Computers and Communications 2004 Volume 2 (ISCC"04) - Volume 02
Networks of Learning Automata: Techniques for Online Stochastic Optimization

Networks of Learning Automata: Techniques for Online Stochastic Optimization
Node density control for maximizing wireless sensor network lifetime

International Journal of Network Management
Wireless sensor network survey

Computer Networks: The International Journal of Computer and Telecommunications Networking
Decentralised coordination of low-power embedded devices using the max-sum algorithm

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 2
Energy-Efficient Area Monitoring for Sensor Networks

Computer
DCOPs meet the realworld: exploring unknown reward matrices with applications to mobile sensor networks

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Decentralized Learning in Markov Games

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Theoretical considerations of potential-based reward shaping for multi-agent systems

The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Long-term information collection with energy harvesting wireless sensors: a multi-armed bandit based approach

Autonomous Agents and Multi-Agent Systems
Reinforcement Learning for Multiple Access Control in Wireless Sensor Networks: Review, Model, and Open Issues

Wireless Personal Communications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this work we present a reinforcement learning algorithm that aims to increase the autonomous lifetime of a Wireless Sensor Network (WSN) and decrease its latency in a decentralized manner. WSNs are collections of sensor nodes that gather environmental data, where the main challenges are the limited power supply of nodes and the need for decentralized control. To overcome these challenges, we make each sensor node adopt an algorithm to optimize the efficiency of a small group of surrounding nodes, so that in the end the performance of the whole system is improved. We compare our approach to conventional ad-hoc networks of different sizes and show that nodes in WSNs are able to develop an energy saving behaviour on their own and significantly reduce network latency, when using our reinforcement learning algorithm.