Urban traffic signal learning control using fuzzy actor-critic methods

Authors:
Li Chun-Gui;Wang Meng;Sun Zi-Gaung;Lin Fei-Ying;Zhang Zeng-Fang
Affiliations:
Department of Computer Engineering, Guangxi University of Technology, Liuzhou, China;Department of Computer Engineering, Guangxi University of Technology, Liuzhou, China;Department of Computer Engineering, Guangxi University of Technology, Liuzhou, China;Department of Computer Engineering, Guangxi University of Technology, Liuzhou, China;Department of Computer Engineering, Guangxi University of Technology, Liuzhou, China
Venue:
ICNC'09 Proceedings of the 5th international conference on Natural computation
Year:
2009

Citing 3
Cited 0

Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
A fuzzy Actor-Critic reinforcement learning network

Information Sciences: an International Journal
Restricted gradient-descent algorithm for value-function approximation in reinforcement learning

Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

Urban traffic control is very complicated, so it is very difficult to build a precise mathematical model. In this paper, we propose a fuzzy Actor-Critic reinforcement leaning algorithm to control the traffic signal, thus the decision can be made dynamically according to real-time traffic state information, and the change of environment can be adapted automatically; In order to solve the curse of the dimensionality problem, we applied fuzzy radial basis function (FRBF) neural network to approximate the state value function. By training self-adapted nonlinear processing unit, and realizing online and adaptive constructing of state space, the approximation is improved, thus the control of traffic signal at single intersections is solved. The simulation results show that the effectiveness of the new control algorithm is obviously better than traditional sliced time allocation methods.