多模态遥感图像模板匹配Log-Gabor滤波方法

doi:10.11947/j.AGCS.2024.20230059

摘要/Abstract

摘要： 针对多模态遥感图像匹配难的问题,本文提出了一种基于Log-Gabor滤波的高精度匹配方法。该方法采用由粗到细的多层级密集匹配框架,无须进行特征点检测,避开了多模态图像特征点检测重复率低的问题,能够提取大量高精度匹配点对。本文方法主要分为两步:首先,利用多尺度多角度Log-Gabor滤波器构建对图像间非线性辐射差异稳健的特征金字塔;然后,利用粗尺度的底层特征图进行密集模板匹配,提取大量粗粒度的特征匹配点对,在此基础上再利用特征金字塔,实现粗匹配点自下而上的逐层优化,完成高精度特征匹配点对的提取。同时,针对模板匹配滑窗运算效率不高的问题,提出了一种密集模板匹配的快速实现方式,有效减少了密集模板匹配的运算时间。本文使用多组不同模态的遥感图像进行试验,结果表明,本文方法能够克服图像间非线性辐射差异的影响,在正确匹配数目、匹配准确率与匹配精度上均优于现有多模态图像特征匹配方法。

关键词: 多模态遥感图像, 特征匹配, Log-Gabor滤波, 模板匹配, 非线性辐射差异

Abstract: A feature matching method based on Log-Gabor filtering is proposed to address the problem of high-precision matching for multimodal remote sensing images. The method adopts a multi-scale dense matching framework via a coarse-to-fine manner, which avoids the low repeatability problem of feature detectors in multimodal images and is able to extract a large number of accurate correspondences. The method consists of two main steps: first, a feature pyramid robust to non-linear radiometric differences between images is constructed using multi-scale multi-angle Log-Gabor filters; then, the coarse feature map is used for dense template matching to extract a large number of coarse feature correspondences; the feature pyramid is then used to achieve bottom-up refinement of coarse correspondences layer by layer. Furthermore, to address the problem of inefficient sliding window operation for template matching, a fast implementation method of dense template matching is proposed, which effectively reduces the running time of dense template matching. The results show that the proposed method can overcome the influence of non-linear radiation differences between images, and outperforms existing multimodal image feature matching methods in terms of the number of correct matches, matching accuracy and matching precision.

Key words: multi-modal remote sensing image, feature matching, Log-Gabor filter, template matching, nonlinear radiation difference

中图分类号:

P258

曹帆之, 石添鑫, 韩开杨, 汪璞, 安玮. 多模态遥感图像模板匹配Log-Gabor滤波方法[J]. 测绘学报, 2024, 53(3): 526-536.

CAO Fanzhi, SHI Tianxin, HAN Kaiyang, WANG Pu, AN Wei. Log-Gabor filter-based high-precision multi-modal remote sensing image matching[J]. Acta Geodaetica et Cartographica Sinica, 2024, 53(3): 526-536.

参考文献

[1] 眭海刚, 刘畅, 干哲, 等. 多模态遥感图像匹配方法综述[J]. 测绘学报, 2022, 51(9):1848-1861.DOI:10.11947/j.AGCS.2022.20220126. SUI Haigang, LIU Chang, GAN Zhe, et al. Overview of multi-modal remote sensing image matching methods[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(9):1848-1861.DOI:10.11947/j.AGCS.2022.20220126.
[2] MA Jiayi, JIANG Xingyu, FAN Aoxiang, et al. Image matching from handcrafted to deep features:a survey[J]. International Journal of Computer Vision, 2021, 129(1):23-79.
[3] JIANG Xingyu, MA Jiayi, XIAO Guobao, et al. A review of multimodal image matching:methods and applications[J]. Information Fusion, 2021, 73(C):22-71.
[4] LI Jiayuan, HU Qingwu, AI Mingyao. RIFT:multi-modal image matching based on radiation-variation insensitive feature transform[J]. IEEE Transactions on Image Processing, 2019, 29:3296-3310.
[5] HONG Danfeng, GAO Lianru, YAO Jing, et al. Graph convolutional networks for hyperspectral image classification[J]. IEEE Tran-sactions on Geoscience and Remote Sensing, 2021, 59(7):5966-5978.
[6] HONG Danfeng, GAO Lianru, YOKOYA N, et al. More diverse means better:multimodal deep learning meets remote-sensing imagery classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(5):4340-4354.
[7] WU Xin, HONG Danfeng, CHANUSSOT J. UIU-Net:U-Net in U-Net for infrared small object detection[J]. IEEE Transactions on Image Processing, 2022, 32:364-376.
[8] WU Xin, HONG Danfeng, CHANUSSOT J. Convolutional neural networks for multimodal remote sensing data classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2021, 60:1-10.
[9] CUI Song, MA Ailong, WAN Yuting, et al. Cross-modality image matching network with modality-invariant feature representation for airborne-ground thermal infrared and visible datasets[J]. IEEE Transactions on Geoscience and Remote Sensing, 2021, 60:1-14.
[10] DENG Yuxin, MA Jiayi. ReDFeat:recoupling detection and description for multimodal feature learning[J]. IEEE Transactions on Image Processing, 2023, 32:591-602.
[11] ZHANG Yongjun, YAO Yongxiang, WAN Yi, et al. Histogram of the orientation of the weighted phase descriptor for multi-modal remote sensing image matching[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2023, 196:1-15.
[12] YE Yuanxin, SHAN Jie, HAO Siyuan, et al. A local phase based invariant feature for remote sensing image matching[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 142:205-221.
[13] 叶沅鑫, 慎利, 陈敏, 等. 局部相位特征描述的多源遥感影像自动匹配[J]. 武汉大学学报(信息科学版), 2017, 42(9):1278-1284. YE Yuanxin, SHEN Li, CHEN Min, et al. An automatic matching method based on local phase feature descriptor for multi-source remote sensing images[J]. Geomatics and Information Science of Wuhan University, 2017, 42(9):1278-1284.
[14] YE Yuanxin, BRUZZONE L, SHAN Jie, et al. Fast and robust matching for multimodal remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(11):9059-9070.
[15] MA Wenping, ZHANG Jun, WU Yue, et al. A novel two-step registration method for remote sensing images based on deep and local features[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(7):4834-4843.
[16] ZHANG Wannan. Combination of SIFT and canny edge detection for registration between SAR and optical images[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19:3043025.
[17] 姚永祥, 张永军, 万一, 等. 顾及各向异性加权力矩与绝对相位方向的异源影像匹配[J]. 武汉大学学报(信息科学版), 2021, 46(11):1727-1736. YAO Yongxiang, ZHANG Yongjun, WAN Yi, et al. Heterologous images matching considering anisotropic weighted moment and absolute phase orientation[J]. Geomatics and Information Science of Wuhan University, 2021, 46(11):1727-1736.
[18] LI Jiayuan, XU Wangyi, SHI Pengcheng, et al. LNIFT:locally normalized image for rotation invariant multimodal feature matching[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60:1-14.
[19] SEDAGHAT A, MOHAMMADI N. Illumination-robust remote sensing image matching based on oriented self-similarity[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 153:21-35.
[20] ZHU Bai, YANG Chao, DAI Jinkun, et al. R2FD2:fast and robust matching of multimodal remote sensing images via repeatable feature detector and rotation-invariant feature descriptor[J]. IEEE Transactions on Geoscience and Remote Sensing, 2023, 61:1-15.
[21] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[22] KOVESI P. Image features from phase congruency image features from phase congruency[J]. Videre:Journal of Computer Vision Research, 1999, 1(3):1-26.
[23] WU Yue, MA Wenping, GONG Maoguo, et al. A novel point-matching algorithm based on fast sample consensus for image registration[J]. IEEE Geoscience and Remote Sensing Letters, 2015, 12(1):43-47.
[24] MANJUNATH B S, OHM J R, VASUDEVAN V V, et al. Color and texture descriptors[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2001, 11(6):703-715.
[25] AGUILERA C A, SAPPA A D, TOLEDO R. LGHD:a feature descriptor for matching across non-linear intensity variations[C]//Proceedings of 2015 IEEE International Conference on Image Processing. Quebec City:IEEE, 2015:178-181.
[26] ZHOU Qunjie, SATTLER T, LEAL-TAIXE L. Patch2Pix:epipolar-guided pixel-level correspondences[C]//Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville:IEEE, 2021:4669-4678.