A region-based multi-sensor image fusion scheme using pulse-coupled neural network
Pattern Recognition Letters
Pixel- and region-based image fusion with complex wavelets
Information Fusion
Multifocus image fusion by combining curvelet and wavelet transform
Pattern Recognition Letters
Multifocus image fusion using the nonsubsampled contourlet transform
Signal Processing
Visible and IR Data Fusion Technique Using the Contourlet Transform
CSE '09 Proceedings of the 2009 International Conference on Computational Science and Engineering - Volume 02
Non-Gaussian model-based fusion of noisy images in the wavelet domain
Computer Vision and Image Understanding
A Novel Multimodality Image Fusion Method Using Region Consistency Rule
PReMI '09 Proceedings of the 3rd International Conference on Pattern Recognition and Machine Intelligence
A Novel Hybrid Pansharpening Method Using Contourlet Transform
PReMI '09 Proceedings of the 3rd International Conference on Pattern Recognition and Machine Intelligence
A novel region based image fusion method using highboost filtering
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
The Shiftable Complex Directional Pyramid—Part II: Implementation and Applications
IEEE Transactions on Signal Processing - Part I
The Shiftable Complex Directional Pyramid—Part I: Theoretical Aspects
IEEE Transactions on Signal Processing - Part I
Gradient-based multiresolution image fusion
IEEE Transactions on Image Processing
The contourlet transform: an efficient directional multiresolution image representation
IEEE Transactions on Image Processing
The Nonsubsampled Contourlet Transform: Theory, Design, and Applications
IEEE Transactions on Image Processing
Multimodality image fusion by using both phase and magnitude information
Pattern Recognition Letters
Multi-focus image fusion based on the neighbor distance
Pattern Recognition
Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Multisensor video fusion based on spatial-temporal salience detection
Signal Processing
Hi-index | 0.10 |
For multimodality images, a novel fusion algorithm based on the shiftable complex directional pyramid transform (SCDPT) is proposed in this paper. As well, with the aid of the structural similarity (SSIM) index, a 'similarity-based' idea is employed to distinguish regions with 'redundant' or 'complementary' information between source imagers before the SCDPT coefficients are merged. A 'weighted averaging' scheme for regions with 'redundant' information and a 'selecting' scheme for regions with 'complementary' information are then employed, respectively. When merging the low-pass subband coefficients, the SSIM index in spatial domain (SP-SSIM) is employed as similarity measure, and three types of regions are thus determined. Especially, for regions with similar intensity values but different intensity changing directions between source images, a 'selecting' scheme based on gradient and energy is proposed. When merging the directional band-pass subband coefficients, the SSIM index in complex wavelet domain (CW-SSIM) is employed as similarity measure. With the CW-SSIM index, not only the magnitude information but also the phase information of SCDPT coefficients can be employed. Compared to the traditional energy matching (EM) index based fusion methods, the proposed method can better deal with 'redundant' and 'complementary' information of source images. In addition, because of the shift-invariance of the SCDPT and the CW-SSIM index, the proposed fusion algorithm performs well even if the input images are not well registered. Several sets of experimental results demonstrate the validity and feasibility of the proposed method in terms of both visual quality and objective evaluation.