Distributed self-learning scheduling approach for wireless sensor network

Authors:
Jianjun Niu;Zhidong Deng
Affiliations:
State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, ...;State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, ...
Venue:
Ad Hoc Networks
Year:
2013

Citing 21
Cited 1

Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence

Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
Wireless sensor networks: a survey

Computer Networks: The International Journal of Computer and Telecommunications Networking
Continuous-Action Q-Learning

Machine Learning
An adaptive energy-efficient MAC protocol for wireless sensor networks

Proceedings of the 1st international conference on Embedded networked sensor systems
Interpolation-based Q-learning

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Versatile low power media access for wireless sensor networks

SenSys '04 Proceedings of the 2nd international conference on Embedded networked sensor systems
A survey of energy-efficient scheduling mechanisms in sensor networks

Mobile Networks and Applications
X-MAC: a short preamble MAC protocol for duty-cycled wireless sensor networks

Proceedings of the 4th international conference on Embedded networked sensor systems
DW-MAC: a low latency, energy efficient demand-wakeup MAC protocol for wireless sensor networks

Proceedings of the 9th ACM international symposium on Mobile ad hoc networking and computing
Link scheduling in wireless sensor networks: Distributed edge-coloring revisited

Journal of Parallel and Distributed Computing
Wireless sensor network survey

Computer Networks: The International Journal of Computer and Telecommunications Networking
Energy efficiency in wireless sensor networks using sleep mode TDMA scheduling

Ad Hoc Networks
RI-MAC: a receiver-initiated asynchronous duty cycle MAC protocol for dynamic traffic loads in wireless sensor networks

Proceedings of the 6th ACM conference on Embedded network sensor systems
A building block approach to sensornet systems

Proceedings of the 6th ACM conference on Embedded network sensor systems
Energy conservation in wireless sensor networks: A survey

Ad Hoc Networks
Reinforcement distribution in fuzzy Q-learning

Fuzzy Sets and Systems
CMAC: An energy-efficient MAC layer protocol using convergent packet forwarding for wireless sensor networks

ACM Transactions on Sensor Networks (TOSN)
Adaptive ad hoc self-organizing scheduling for quasi-periodic sensor network lifetime

Computer Communications
A low power listening MAC with scheduled wake up after transmissions for WSNs

IEEE Communications Letters
ZeroCal: automatic MAC protocol calibration

DCOSS'10 Proceedings of the 6th IEEE international conference on Distributed Computing in Sensor Systems

Reinforcement Learning for Multiple Access Control in Wireless Sensor Networks: Review, Model, and Open Issues

Wireless Personal Communications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

Energy constraints pose great challenges to wireless sensor network (WSN) with battery-powered nodes. But the reduction of energy consumption often introduces additional latency of data delivery. In this paper, a new distributed scheduling approach, self-learning scheduling approach (SSA), is presented in order to reduce energy consumption and to achieve low latency for WSN. This approach, extending the Q-learning method, enables nodes to learn continuous transmission parameter and sleep parameter through interacting with the WSN. We compare SSA with S-MAC protocol and DW-MAC protocol using simulations. The results show that the SSA can make nodes to learn the optimal scheduling policy gradually. The results under different work loads also exhibit that SSA performs much better than S-MAC protocol and DW-MAC protocol in terms of energy consumption and throughput. With regard to latency and maximum queue length, SSA also outperforms the other two MAC protocols in the scenarios, where the collision is serious and the work load is heavy.