Coordination of urban intersection agents based on multi-interaction history learning method

  • Authors:
  • Xinhai Xia;Lunhui Xu

  • Affiliations:
  • ,School of Civil Engineering and Transportation, South China University of Technology, Guangzhou, China;School of Civil Engineering and Transportation, South China University of Technology, Guangzhou, China

  • Venue:
  • ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part II
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The high growth rate of vehicles per capita now poses a real challenge to efficient Urban Traffic Control (UTC).An efficient solution to UTC must be adaptive in order to deal with the highly-dynamic nature of urban traffic. In this paper we have adopted a multi-interactive history learning approach for coordination of urban intersection traffic signal agents. The design employs an agent controller for each signalized intersection that coordinates with neighbouring agents.Multi-interaction model for urban intersection traffic signal agents was built based on two-person game which has been applied to let agents learn how to cooperate. A multi-interactive history learning history algorithm(HL) was constructed. This algorithm takes all history interactive information which comes from neighbouring agents into account. In the algorithm proposed, the learning rule assigns greater significance to recent than to past payoff information. To achieve this motivation ,a memory factor δ is used in order to avoid the complete neglect of the payoff obtained by one action in the past. The memory factor namedäreflects the influence of newer interactive information on the Agent decision.How it will affect the algorithm's performance was analysed by the experiment with traffic control of a few connected intersections .Analyzing the results, one sees that the memory factor has an effect on the time needed to reach a given pattern of coordination.