Multiclass object classification for real-time video surveillance systems

  • Authors:
  • Yaniv Gurwicz;Raanan Yehezkel;Boaz Lachover

  • Affiliations:
  • Video Analytics Group, NICE Systems Ltd., 22 Zarhin Street, POB 4122, Raanana 43622, Israel;Video Analytics Group, NICE Systems Ltd., 22 Zarhin Street, POB 4122, Raanana 43622, Israel;Video Analytics Group, NICE Systems Ltd., 22 Zarhin Street, POB 4122, Raanana 43622, Israel

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2011

Quantified Score

Hi-index 0.10

Visualization

Abstract

Object classification in video is an important factor for improving the reliability of various automatic applications in video surveillance systems, as well as a fundamental feature for advanced applications, such as scene understanding. Despite extensive research, existing methods exhibit relatively moderate classification accuracy when tested on a large variety of real-world scenarios, or do not obey the real-time constraints of video surveillance systems. Moreover, their performance is further degraded in multi-class classification problems. We explore multi-class object classification for real-time video surveillance systems and propose an approach for classifying objects in both low and high resolution images (human height varies from a few to tens of pixels) in varied real-world scenarios. Firstly, we present several features that jointly leverage the distinction between various classes. Secondly, we provide a feature-selection procedure based on entropy gain, which screens out superfluous features. Experiments, using various classification techniques, were performed on a large and varied database consisting of ~29,000 object instances extracted from 140 different real-world indoor and outdoor, near-field and far-field scenes having various camera viewpoints, which capture a large variety of object appearances under real-world environmental conditions. The insight raised from the experiments is threefold: the efficiency of our feature set in discriminating between classes, the performance improvement when using the feature selection method, and the high classification accuracy obtained on our real-time system on both DSP (TMS320C6415-6E3, 600MHz) and PC (Quad Core Intel(R) Xeon(R) E5310, 2x4MB Cache, 1.60GHz, 1066MHz) platforms.