In-vehicle camera traffic sign detection and recognition

  • Authors:
  • Andrzej Ruta;Fatih Porikli;Shintaro Watanabe;Yongmin Li

  • Affiliations:
  • Brunel University, School of Information Systems, Computing and Mathematics, UB8 3PH, Uxbridge, Middlesex, UK;Mitsubishi Electric Research Laboratories, 201 Broadway, 02139, Cambridge, MA, USA;Mitsubishi Electric Corporation, Advanced Technology R&D Center, Amagasaki, Japan;Brunel University, School of Information Systems, Computing and Mathematics, UB8 3PH, Uxbridge, Middlesex, UK

  • Venue:
  • Machine Vision and Applications
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we discuss theoretical foundations and a practical realization of a real-time traffic sign detection, tracking and recognition system operating on board of a vehicle. In the proposed framework, a generic detector refinement procedure based on mean shift clustering is introduced. This technique is shown to improve the detection accuracy and reduce the number of false positives for a broad class of object detectors for which a soft response’s confidence can be sensibly estimated. The track of an already established candidate is maintained over time using an instance-specific tracking function that encodes the relationship between a unique feature representation of the target object and the affine distortions it is subject to. We show that this function can be learned on-the-fly via regression from random transformations applied to the image of the object in known pose. Secondly, we demonstrate its capability of reconstructing the full-face view of a sign from substantial view angles. In the recognition stage, a concept of class similarity measure learned from image pairs is discussed and its realization using SimBoost, a novel version of AdaBoost algorithm, is analyzed. Suitability of the proposed method for solving multi-class traffic sign classification problems is shown experimentally for different feature representations of an image. Overall performance of our system is evaluated based on a prototype C++ implementation. Illustrative output generated by this demo application is provided as a supplementary material attached to this paper.