Illumination normalization with time-dependent intrinsic images for video surveillance

Authors:
Yasuyuki Matsushita;Ko Nishino;Katsushi Ikeuchi;Masao Sakauchi
Affiliations:
Institute of Industrial Science, The University of Tokyo, Tokyo, Japan;Department of Computer Science, Columbia University, New York;Institute of Industrial Science, The University of Tokyo, Tokyo, Japan;Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
Venue:
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Year:
2003

Citing 6
Cited 6

Model-based object tracking in monocular image sequences of road traffic scenes

International Journal of Computer Vision
The perception of shading and reflectance

Perception as Bayesian inference
The SR-tree: an index structure for high-dimensional nearest neighbor queries

SIGMOD '97 Proceedings of the 1997 ACM SIGMOD international conference on Management of data
Removing Shadows from Images

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Detection of moving cast shadows for object segmentation

IEEE Transactions on Multimedia

Multiplicative Background-Foreground Estimation Under Uncontrolled Illumination using Intrinsic Images

WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
Recovering Intrinsic Images from a Single Image

IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust minimization of lighting variation for real-time defect detection

Real-Time Imaging
Weighted map for reflectance and shading separation using a single image

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Removing shadows from face images using ICA

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part I
Estimation of intrinsic image sequences from image+depth video

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI

Quantified Score

Hi-index	0.00

Visualization

Abstract

Cast shadows produce troublesome effects for video surveillance systems, typically for object tracking from a fixed viewpoint, since it yields appearance variations of objects depending on whether they are inside or outside the shadow. To robustly eliminate these shadows from image sequences as a preprocessing stage for robust video surveillance, we propose a framework based on the idea of intrinsic images. Unlike previous methods for deriving intrinsic images, we derive time-varying reflectance images and corresponding illumination images from a sequence of images. Using obtained illumination images, we normalize the input image sequence in terms of incident lighting distribution to eliminate shadow effects. We also propose an illumination normalization scheme which can potentially run in real time, utilizing the illumination eigenspace, which captures the illumination variation due to weather, time of day etc., and a shadow interpolation method based on shadow hulls. This paper describes the theory of the framework with simulation results, and shows its effectiveness with object tracking results on real scene data sets for traffic monitoring.