Fast matching method of optical and SAR images using rank self-similarity features

doi:10.11947/j.AGCS.2025.20250200

Abstract

Abstract:

To address the image matching challenges arising from the radiometric differences between optical and synthetic aperture radar (SAR) images as well as the speckles inherent in SAR images, a novel and efficient matching method for optical and SAR images is proposed based on 3D phase correlation (PC) of rank self-similarity (RSS) features. The RSS features are extracted rapidly using offset mean filtering, while efficient template matching based on 3D PC is achieved via fast Fourier transform. Experiments conduct on 200 randomly selected optical and SAR image pairs from public datasets demonstrate that the proposed method achieves both reliable and efficient matching of optical and SAR images. The matching results between optical images and Tianhui-2 SAR images further validate the effectiveness of proposed method.

Key words: optical image, synthetic aperture radar image, rank self-similarity, fast Fourier transform, 3D phase correlation

CLC Number:

P237

Xin XIONG, Guowang JIN, Ruibing CUI, Shuo LI, He YANG. Fast matching method of optical and SAR images using rank self-similarity features[J]. Acta Geodaetica et Cartographica Sinica, 2025, 54(10): 1852-1862.

Figures/Tables 15

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Tab. 1

Fig. 8

Fig. 9

Tab. 2

Fig. 10

Fig. 11

Fig. 12

Tab. 3

References 25

[1]	靳国旺, 张红敏, 徐青. 雷达摄影测量[M]. 北京: 测绘出版社, 2015.
	JIN Guowang, ZHANG Hongmin, XU Qing. Radargrammetry[M]. Beijing: Surveying and Mapping Press, 2015.
[2]	张绍明, 陈鹰, 林怡. SAR图像与光学图像多子区鲁棒匹配算法[J]. 同济大学学报(自然科学版), 2009, 37(1): 121-125, 133.
	ZHANG Shaoming, CHEN Ying, LIN Yi. Robust algorithm of matching SAR image to optical image using multiple subarea[J]. Journal of Tongji University (Natural Science), 2009, 37(1): 121-125, 133.
[3]	陈子涵, 王峰, 许宁, 等. 基于改进NSST-PCNN的光学与SAR图像融合去云方法[J]. 遥感技术与应用, 2021, 36(4): 810-819.
	CHEN Zihan, WANG Feng, XU Ning, et al. Cloud removal by fusing optical and SAR images based on improved PCNN in NSST domain[J]. Remote Sensing Technology and Application, 2021, 36(4): 810-819.
[4]	田峰, 李虎. 联合星载光学与SAR图像的城市大面积建筑物高度快速提取[J]. 测绘学报, 2017, 46(7): 891-899. DOI: . doi: 10.11947/j.AGCS.2017.20160573
	TIAN Feng, LI Hu. Fusion of spaceborne optical and SAR images for building height quick extraction in big urban areas[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(7): 891-899. DOI: . doi: 10.11947/j.AGCS.2017.20160573
[5]	吴瑞娟. 基于高分SAR与光学影像数据融合的滨海湿地变化监测方法[J]. 测绘学报, 2021, 50(2): 280. DOI: . doi: 10.11947/j.AGCS.2021.20190504
	WU Ruijuan. Monitoring coastal wetlands changes using fusion of high-resolution SAR and optical images[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(2): 280. DOI: . doi: 10.11947/j.AGCS.2021.20190504
[6]	王志豪, 李刚, 蒋骁. 基于光学和SAR遥感图像融合的洪灾区域检测方法[J]. 雷达学报, 2020, 9(3): 539-553.
	WANG Zhihao, LI Gang, JIANG Xiao. Flooded area detection method based on fusion of optical and SAR remote sensing images[J]. Journal of Radars, 2020, 9(3): 539-553.
[7]	眭海刚, 刘畅, 干哲, 等. 多模态遥感图像匹配方法综述[J]. 测绘学报, 2022, 51(9): 1848-1861. DOI: . doi: 10.11947/j.AGCS.2022.20220126
	SUI Haigang, LIU Chang, GAN Zhe, et al. Overview of multi-modal remote sensing image matching methods[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(9): 1848-1861. DOI: . doi: 10.11947/j.AGCS.2022.20220126
[8]	MA Jiayi, JIANG Xingyu, FAN Aoxiang, et al. Image matching from handcrafted to deep features: a survey[J]. International Journal of Computer Vision, 2021, 129(1): 23-79.
[9]	靳国旺, 熊新, 张红敏, 等. 相同侧视方向异轨SAR图像差异化约束连接点提取[J]. 测绘学报, 2018, 47(1): 91-101. DOI: . doi: 10.11947/j.AGCS.2018.20170129
	JIN Guowang, XIONG Xin, ZHANG Hongmin, et al. Tie point extraction for SAR images with same side-looking direction from different trajectories based on differential constraints[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(1): 91-101. DOI: . doi: 10.11947/j.AGCS.2018.20170129
[10]	SURI S, REINARTZ P. Mutual-information-based registration of TerraSAR-X and Ikonos imagery in urban areas[J]. IEEE Transactions on Geoscience and Remote Sensing, 2010, 48(2): 939-949.
[11]	陈敏, 朱庆, 朱军, 等. SAR影像与光学影像的高斯伽玛型边缘强度特征匹配法[J]. 测绘学报, 2016, 45(3): 318-325. DOI: . doi: 10.11947/j.AGCS.2016.20150084
	CHEN Min, ZHU Qing, ZHU Jun, et al. Feature matching for SAR and optical images based on Gaussian-Gamma shaped edge strength map[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(3): 318-325. DOI: . doi: 10.11947/j.AGCS.2016.20150084
[12]	YE Yuanxin, BRUZZONE L, SHAN Jie, et al. Fast and robust matching for multimodal remote sensing image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(11): 9059-9070.
[13]	XIANG Yuming, TAO Rongshu, WAN Ling, et al. OS-PC: combining feature representation and 3D phase correlation for subpixel optical and SAR image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 58(9): 6451-6466.
[14]	YE Yuanxin, SHAN Jie, BRUZZONE L, et al. Robust registration of multimodal remote sensing images based on structural similarity[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(5): 2941-2958.
[15]	FAN Jianwei, WU Yan, LI Ming, et al. SAR and optical image registration using nonlinear diffusion and phase congruency structural descriptor[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(9): 5368-5379.
[16]	XIANG Yuming, TAO Rongshu, WANG Feng, et al. Automatic registration of optical and SAR images via improved phase congruency model[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 13: 5847-5861.
[17]	YE Yibin, WANG Qinwei, ZHAO Hong, et al. Fast and robust optical-to-SAR remote sensing image registration using region-aware phase descriptor[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62: 5208512.
[18]	孙明超, 马天翔, 宋悦铭, 等. 基于相位特征的可见光和SAR遥感图像自动配准[J]. 光学　精密工程, 2021, 29(3): 616-627.
	SUN Mingchao, MA Tianxiang, SONG Yueming, et al. Automatic registration of optical and SAR remote sensing image based on phase feature[J]. Optics and Precision Engineering, 2021, 29(3): 616-627.
[19]	YE Yuanxin, SHEN Li, HAO Ming, et al. Robust optical-to-SAR image matching based on shape properties[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(4): 564-568.
[20]	XIONG Xin, XU Qing, JIN Guowang, et al. Rank-based local self-similarity descriptor for optical-to-SAR image matching[J]. IEEE Geoscience and Remote Sensing Letters, 2020, 17(10): 1742-1746.
[21]	HONG Yameng, LENG Chengcai, ZHANG Xinyue, et al. Max-index based local self-similarity descriptor for robust multi-modal image registration[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 4505805.
[22]	XIONG Xin, JIN Guowang, XU Qing, et al. Self-similarity features for multimodal remote sensing image matching[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 12440-12454.
[23]	XIONG Xin, JIN Guowang, XU Qing, et al. Robust registration algorithm for optical and SAR images based on adjacent self-similarity feature[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-17.
[24]	ANUTA P E. Spatial registration of multispectral and multitemporal digital imagery using fast Fourier transform techniques[J]. IEEE Transactions on Geoscience Electronics, 1970, 8(4): 353-368.
[25]	YU Qiuze, NI Dawen, JIANG Yuxuan, et al. Universal SAR and optical image registration via a novel SIFT framework based on nonlinear diffusion and a polar spatial-frequency descriptor[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2021, 171: 1-17.

方法	平均匹配正确率	匹配成功率	平均均方根误差/像素	平均匹配耗时/s
DLSS	0.314	0.950	1.939	43.064
DRLSS	0.375	0.960	1.928	60.740
HOPC	0.376	0.950	1.906	35.675
WED-HOPC	0.363	0.960	1.960	42.104
CFOG	0.260	0.905	1.943	1.494
FRSS	0.423	0.950	1.863	1.323

参数类型	廊坊地区	登封地区
获取时间	2020-05-05	2019-10-14
中心入射角/（°）	37.78	40.03
方位向采样间隔/m	2.050 633	1.879 528
距离向采样间隔/m	0.936 851	0.936 851
方位向像元数/像素	19 902	19 414
距离向像元数/像素	21 910	23 014
近距延迟/m	665 688.570 473	688 592.988 933

试验区域	匹配点数量	匹配耗时/s
廊坊地区	351	66.068
登封地区	348	65.234