Background modeling and object tracking using multi-spectral sensors

  • Authors:
  • Cheng-Yao Chen;Wayne Wolf

  • Affiliations:
  • Princeton University, Princeton, New Jersey;Princeton University, Princeton, New Jersey

  • Venue:
  • Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a multi-spectral video surveillance system. Improved background modeling and appearance-based object tracking are proposed with both signal-level and decision-level multi-spectral information fusion. In addition to modeling observations in each spectral channel by a typical pixel-level mixture-of-Gaussian-based model, we also model high level factors such as confidence of each modality, motion, object area, and lighting with a hierarchical probabilistic model feedback. This hierarchical model can enhance the performance of different challenging environment conditions, such as global illumination changes, and random parameter failures of background subtraction. Moreover, real-world vision problems include occlusion and merge/split are managed by our non-parametric tracking methodology and appearance-distance histogram. Our experiment in object tracking shows that under normal conditions, our system extends the capability of single spectral sensor, and under severe environment conditions, the overall system performance outperforms traditional direct fusion techniques in tracking reliability. This promising performance also encourages us to further extend our techniques to general multi-spectral and multi-modal surveillance.