Mutual information refinement for flash-no-flash image alignment

Authors:
Sami Varjo;Jari Hannuksela;Olli Silvén;Sakari Alenius
Affiliations:
Infotech Oulu and Department of Electrical and Information Engineering, University of Oulu, Finland;Infotech Oulu and Department of Electrical and Information Engineering, University of Oulu, Finland;Infotech Oulu and Department of Electrical and Information Engineering, University of Oulu, Finland;Nokia Research Center, Tampere, Finland
Venue:
ACIVS'11 Proceedings of the 13th international conference on Advanced concepts for intelligent vision systems
Year:
2011

Citing 19
Cited 0

SUSAN—A New Approach to Low Level Image Processing

International Journal of Computer Vision
Alignment by Maximization of Mutual Information

International Journal of Computer Vision
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
High dynamic range video

ACM SIGGRAPH 2003 Papers
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Digital photography with flash and no-flash image pairs

ACM SIGGRAPH 2004 Papers
Flash photography enhancement via intrinsic relighting

ACM SIGGRAPH 2004 Papers
Removing photography artifacts using gradient projection and flash-exposure sampling

ACM SIGGRAPH 2005 Papers
Removing photography artifacts using gradient projection and flash-exposure sampling

ACM SIGGRAPH 2005 Papers
Geometric Hashing with Local Affine Frames

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
An efficient illumination normalization method for face recognition

Pattern Recognition Letters
A frequency domain approach to registration of aliased images with application to super-resolution

EURASIP Journal on Applied Signal Processing
Linear Time Maximally Stable Extremal Regions

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II
2D image registration using focused mutual information for application in dentistry

Computers in Biology and Medicine
Normalized mutual information feature selection

IEEE Transactions on Neural Networks
Low-light imaging solutions for mobile devices

Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
SURF: speeded up robust features

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
An FFT-based technique for translation, rotation, and scale-invariant image registration

IEEE Transactions on Image Processing
Extension of phase correlation to subpixel registration

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.02

Visualization

Abstract

Flash-no-flash imaging aims to combine ambient light images with details available in flash images. Flash can alter color intensities radically leading to changes in gradient directions and strengths, as well as natural shadows possibly being removed and new ones created. This makes flash-no-flash image pair alignment a challenging problem. In this paper, we present a new image registration method utilizing mutual information driven point matching accuracy refinement. For a phase correlation based method, accuracy improvement through the suggested point refinement was over 40 %. The new method also performed better than the reference methods SIFT and SURF by 3.0 and 9.1 % respectively in alignment accuracy. Visual inspection also confirmed that in several cases the proposed method succeeded in registering flash-no-flash image pairs where the tested reference methods failed.