Fusion of thermal infrared and visible spectrum video for robust surveillance

Authors:
Praveen Kumar;Ankush Mittal;Padam Kumar
Affiliations:
Department of Electronics and Computer Engineering, Indian Institute of Technology, Roorkee, India;Department of Electronics and Computer Engineering, Indian Institute of Technology, Roorkee, India;Department of Electronics and Computer Engineering, Indian Institute of Technology, Roorkee, India
Venue:
ICVGIP'06 Proceedings of the 5th Indian conference on Computer Vision, Graphics and Image Processing
Year:
2006

Citing 5
Cited 6

Kinematic based Human Motion Analysis in Infrared Sequences

WACV '02 Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision
Automatic Camera Selection and Fusion for Outdoor Surveillance under Changing Weather Conditions

AVSS '03 Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance
Robust Detection of People in Thermal Imagery

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
Multimedia surveillance systems

Proceedings of the third ACM international workshop on Video surveillance & sensor networks
A survey on visual surveillance of object motion and behaviors

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews

Addressing uncertainty in multi-modal fusion for improved object detection in dynamic environment

Information Fusion
Background subtraction for automated multisensor surveillance: a comprehensive review

EURASIP Journal on Advances in Signal Processing - Special issue on advanced image processing for defense and security applications
Poly-DWT: Polymorphic wavelet hardware support for dynamic image compression

ACM Transactions on Embedded Computing Systems (TECS)
Algorithms for a real-time HDR video system

Pattern Recognition Letters
INT3-Horus framework for multispectrum activity interpretation in intelligent environments

Expert Systems with Applications: An International Journal
Thermal cameras and applications: a survey

Machine Vision and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an approach of fusing the information provided by visible spectrum video with that of thermal infrared video to tackle video processing challenges such as object detection and tracking for increasing the performance and robustness of the surveillance system. An enhanced object detection strategy using gradient information along with background subtraction is implemented with efficient fusion based approach to handle typical problems in both the domains. An intelligent fusion approach using Fuzzy logic and Kalman filtering technique is proposed to track objects and obtain fused estimate according to the reliability of the sensors. Appropriate measurement parameters are identified to determine the measurement accuracy of each sensor. Experimental results are shown on some typical scenarios of detection and tracking of pedestrians.