Evaluation of an adaptive traffic control technique with underlying system changes
WSC '95 Proceedings of the 27th conference on Winter simulation
Multi-criteria Reinforcement Learning
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Multi-Agent Reinforcement Leraning for Traffic Light Control
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
A Geometric Approach to Multi-Criterion Reinforcement Learning
The Journal of Machine Learning Research
Dynamic preferences in multi-criteria reinforcement learning
ICML '05 Proceedings of the 22nd international conference on Machine learning
Multiagent Reinforcement Learning for Urban Traffic Control Using Coordination Graphs
ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations
Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations
A Collaborative Reinforcement Learning Approach to Urban Traffic Control Optimization
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 02
Opportunities for multiagent systems and multiagent reinforcement learning in traffic control
Autonomous Agents and Multi-Agent Systems
IEEE Transactions on Intelligent Transportation Systems
Distributed geometric fuzzy multiagent urban traffic signal control
IEEE Transactions on Intelligent Transportation Systems
Multiobjective reinforcement learning for traffic signal control using vehicular ad hoc network
EURASIP Journal on Advances in Signal Processing - Special title on vehicular ad hoc networks
Modeling traffic signal control using Petri nets
IEEE Transactions on Intelligent Transportation Systems
Urban traffic control structure based on hybrid Petri nets
IEEE Transactions on Intelligent Transportation Systems
Coordinated road-junction traffic control by dynamic programming
IEEE Transactions on Intelligent Transportation Systems
Neural Networks for Real-Time Traffic Signal Control
IEEE Transactions on Intelligent Transportation Systems
Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Reinforcement Learning With Function Approximation for Traffic Signal Control
IEEE Transactions on Intelligent Transportation Systems
Fast Model Predictive Control for Urban Road Networks via MILP
IEEE Transactions on Intelligent Transportation Systems
A New Multiobjective Signal Optimization for Oversaturated Networks
IEEE Transactions on Intelligent Transportation Systems
Enhanced Multiagent Multi-objective Reinforcement Learning for Urban Traffic Light Control
ICMLA '12 Proceedings of the 2012 11th International Conference on Machine Learning and Applications - Volume 01
Hi-index | 0.00 |
In this paper, we focus on computing a consistent traffic signal configuration at each junction that optimizes multiple performance indices, i.e., multi-objective traffic signal control. The multi-objective function includes minimizing trip waiting time, total trip time, and junction waiting time. Moreover, the multi-objective function includes maximizing flow rate, satisfying green waves for platoons traveling in main roads, avoiding accidents especially in residential areas, and forcing vehicles to move within moderate speed range of minimum fuel consumption. In particular, we formulate our multi-objective traffic signal control as a multi-agent system (MAS). Traffic signal controllers have a distributed nature in which each traffic signal agent acts individually and possibly cooperatively in a MAS. In addition, agents act autonomously according to the current traffic situation without any human intervention. Thus, we develop a multi-agent multi-objective reinforcement learning (RL) traffic signal control framework that simulates the driver's behavior (acceleration/deceleration) continuously in space and time dimensions. The proposed framework is based on a multi-objective sequential decision making process whose parameters are estimated based on the Bayesian interpretation of probability. Using this interpretation together with a novel adaptive cooperative exploration technique, the proposed traffic signal controller can make real-time adaptation in the sense that it responds effectively to the changing road dynamics. These road dynamics are simulated by the Green Light District (GLD) vehicle traffic simulator that is the testbed of our traffic signal control. We have implemented the Intelligent Driver Model (IDM) acceleration model in the GLD traffic simulator. The change in road conditions is modeled by varying the traffic demand probability distribution and adapting the IDM parameters to the adverse weather conditions. Under the congested and free traffic situations, the proposed multi-objective controller significantly outperforms the underlying single objective controller which only minimizes the trip waiting time (i.e., the total waiting time in the whole vehicle trip rather than at a specific junction). For instance, the average trip and waiting times are ~8 and 6 times lower respectively when using the multi-objective controller.