Cognitive network management with reinforcement learning for wireless mesh networks

Authors:
Minsoo Lee;Dan Marconett;Xiaohui Ye;S. J. Ben Yoo
Affiliations:
Dept. Electrical and Computer Engineering, University of California, Davis, Davis, CA;Dept. Electrical and Computer Engineering, University of California, Davis, Davis, CA;Dept. Electrical and Computer Engineering, University of California, Davis, Davis, CA;Dept. Electrical and Computer Engineering, University of California, Davis, Davis, CA
Venue:
IPOM'07 Proceedings of the 7th IEEE international conference on IP operations and management
Year:
2007

Citing 12
Cited 6

Distributed Clustering for Ad Hoc Networks

ISPAN '99 Proceedings of the 1999 International Symposium on Parallel Architectures, Algorithms and Networks
Adaptive Routing for Sensor Networks using Reinforcement Learning

CIT '06 Proceedings of the Sixth IEEE International Conference on Computer and Information Technology
Cross-Layering in Mobile Ad Hoc Network Design

Computer
Model based Bayesian exploration

UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Mesh WLAN networks: concept and system design

IEEE Wireless Communications
Cross-layer design: a survey and the road ahead

IEEE Communications Magazine
Cross-layer design for resource allocation in 3G wireless networks and beyond

IEEE Communications Magazine
Ad hoc innovation: distributed decision making in ad hoc networks

IEEE Communications Magazine
Mobileman: design, integration, and experimentation of cross-layer mobile multihop ad hoc networks

IEEE Communications Magazine
Key Challenges of Military Tactical Networking and the Elusive Promise of MANET Technology

IEEE Communications Magazine
Cognitive networks: adaptation and learning to achieve end-to-end performance objectives

IEEE Communications Magazine
Quality-Aware Routing Metrics for Time-Varying Wireless Mesh Networks

IEEE Journal on Selected Areas in Communications

A reinforcement learning-based lightpath establishment for service differentiation in all-optical WDM networks

GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Traffic engineering supported by inherent network management: analysis of resource efficiency and cost saving potential

International Journal of Network Management
A negotiation-based networking methodology to enable cooperation across heterogeneous co-located networks

Ad Hoc Networks
Reinforcement learning based routing in wireless mesh networks

Wireless Networks
Self-healing in transparent optical packet switching mesh networks: A reinforcement learning perspective

Computer Networks: The International Journal of Computer and Telecommunications Networking
A reinforcement learning based solution for cognitive network cooperation between co-located, heterogeneous wireless sensor networks

Ad Hoc Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a framework of cognitive network management by means of an autonomic reconfiguration scheme. We propose a network architecture that enables intelligent services to meet QoS requirements, by adding autonomous intelligence, based on reinforcement learning, to the network management agents. The management system is shown to be better able to reconfigure its policy strategy around areas of interest and adapt to changes. We present preliminary simulation results showing our autonomous reconfiguration approach successfully improves the performance of the original AODV protocol in a heterogeneous network environment.