A vision-based system for a UGV to handle a road intersection

  • Authors:

  • Javed Ahmed;Mubarak Shah;Andrew Miller;Don Harper;M. N. Jafri

  • Affiliations:

  • Computer Vision Lab, University of Central Florida, Orlando, FL and Electrical Eng. Dept., National University of Sciences and Technology, Rawalpindi, Pakistan;Computer Vision Lab, University of Central Florida, Orlando, FL;Computer Vision Lab, University of Central Florida, Orlando, FL;Computer Vision Lab, University of Central Florida, Orlando, FL;Electrical Eng. Dept., National University of Sciences and Technology, Rawalpindi, Pakistan

  • Venue:
  • AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a real-time computer vision system that enables a UGV to safely cross urban road-intersections. Specifically, when the UGV approaches the stop sign at a 4-way intersection, it must be aware of the vehicles at the other three roads and adhere to traffic rules by waiting for its turn to proceed. The proposed solution consists of three main components: a vehicle detector, a tracker, and a finite-state-machine to model the traffic. We use an OT-MACH filter to detect the leading vehicle in each of three camera-views of the corresponding roads. Then, we track the vehicles using an edge-enhanced dynamic correlation tracker, which estimates the current and next positions, velocities, and accelerations of the vehicles. Finally, the finite-state-machine describes the traffic in each road with one of four possible states (i.e. No Vehicle Waiting, Arriving, Waiting, and Passing), and signals an autopilot system when it is safe to pass the intersection. We provide the results from an actual intersection with real traffic to demonstrate that the UGV is able to automatically navigate the intersection using the proposed system.