Geodesic Active Contour Based Fusion of Visible and Infrared Video for Persistent Object Tracking

Authors:
F. Bunyak;K. Palaniappan;S. K. Nath;G. Seetharaman
Affiliations:
University of Missouri-Columbia;University of Missouri-Columbia;University of Missouri-Columbia;Air Force Institute of Technology
Venue:
WACV '07 Proceedings of the Eighth IEEE Workshop on Applications of Computer Vision
Year:
2007

Citing 0
Cited 7

Parametric active contours for object tracking based on matching degree image of object contour points

Pattern Recognition Letters
Understanding transit scenes: a survey on human behavior-recognition algorithms

IEEE Transactions on Intelligent Transportation Systems
A robust fully automatic scheme for general image segmentation

Digital Signal Processing
Fast texture energy based image segmentation using Directional Walsh-Hadamard Transform and parametric active contour models

Expert Systems with Applications: An International Journal
Parallel implementation of the integral histogram

ACIVS'11 Proceedings of the 13th international conference on Advanced concepts for intelligent vision systems
Feature prominence-based weighting scheme for video tracking

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Multichannel texture image segmentation using local feature fitting based variational active contours

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Persistent object tracking in complex and adverse environments can be improved by fusing information from multiple sensors and sources. We present a new moving object detection and tracking system that robustly fuses infrared and visible video within a level set framework. We also introduce the concept of the flux tensor as a generalization of the 3D structure tensor for fast and reliable motion detection without eigen-decomposition. The infrared flux tensor provides a coarse segmentation that is less sensitive to illumination variations and shadows. The Beltrami color metric tensor is used to define a color edge stopping function that is fused with the infrared edge stopping function based on the grayscale structure tensor. The min fusion operator combines salient contours in either the visible or infrared video and drives the evolution of the multispectral geodesic active contour to refine the coarse initial flux tensor motion blobs. Multiple objects are tracked using correspondence graphs and a cluster trajectory analysis module that resolves incorrect merge events caused by under- segmentation of neighboring objects or partial and full occlusions. Long-term trajectories for object clusters are estimated using Kalman filtering and watershed segmentation. We have tested the persistent object tracking system for surveillance applications and demonstrate that fusion of visible and infrared video leads to significant improvements for occlusion handling and disambiguating clustered groups of objects.