Multiple Adaptive Agents for Tactical Driving

  • Authors:
  • Rahul Sukthankar;Shumeet Baluja;John Hancock

  • Affiliations:
  • Justsystem Pittsburgh Research Center, 4616 Henry St., Pittsburgh PA 15213/ and The Robotics Institute, Carnegie Mellon University, Pittsburgh PA 15213-3891. E-mail: rahuls&commat/jprc.com, baluja ...;Justsystem Pittsburgh Research Center, 4616 Henry St., Pittsburgh PA 15213/ and The Robotics Institute, Carnegie Mellon University, Pittsburgh PA 15213-3891. E-mail: rahuls&commat/jprc.com, baluja ...;The Robotics Institute, Carnegie Mellon University, Pittsburgh PA 15213-3891. E-mail: jhancock&commat/ri.cmu.edu

  • Venue:
  • Applied Intelligence
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recent research in automated highway systems has ranged fromlow-level vision-based controllers to high-level route-guidance software.However, there is currently no system for tactical-level reasoning. Such asystem should address tasks such as passing cars, making exits on time, andmerging into a traffic stream. Many previous approaches have attempted tohand construct large rule-based systems which capture the interactionsbetween multiple input sensors, dynamic and potentially conflictingsubgoals, and changing roadway conditions. However, these systems areextremely difficult to design due to the large number of rules, the manualtuning of parameters within the rules, and the complex interactions betweenthe rules. Our approach to this intermediate-level planning is a systemwhich consists of a collection of autonomous agents, each of whichspecializes in a particular aspect of tactical driving. Each agent examinesa subset of the intelligent vehicle‘s sensors and independently recommendsdriving decisions based on their local assessment of the tacticalsituation. This distributed framework allows different reasoning agents tobe implemented using different algorithms.When using a collection of agents to solve a single task, it is vital tocarefully consider the interactions between the agents. Since each reasoningobject contains several internal parameters, manually finding values forthese parameters while accounting for the agents‘ possible interactions is atedious and error-prone task. In our system, these parameters, and thesystem‘s overall dependence on each agent, is automatically tuned using anovel evolutionary optimization strategy, termed Population-BasedIncremental Learning (PBIL).Our system, which employs multiple automatically trained agents, cancompetently drive a vehicle, both in terms of the user-defined evaluationmetric, and as measured by their behavior on several driving situationsculled from real-life experience. In this article, we describe a method formultiple agent integration which is applied to the automated highway systemdomain. However, it also generalizes to many complex robotics tasks wheremultiple interacting modules must simultaneously be configured withoutindividual module feedback.