PolSAR image registration combining polarization whitening filtering and SimSD-CapsuleNet

doi:10.11947/j.AGCS.2024.20230197

Abstract

Abstract: Polarimetric synthetic aperture radar (PolSAR) image registration has a wide range of applications in feature classification, change detection, and image fusion. Existing PolSAR image registration methods, whether based on deep learning or conventional methods, use PolSAR magnitude image information for processing. This processing leads to a large amount of polarization information loss, and at the same time, the registration accuracy and reliability perform poorly under the influence of the inherent coherent speckle noise of PolSAR images. To this end, this paper first develops a novel and effective key point detector based on polarization whitening filter (PWF) refinement processing, which uses PWF to suppress coherent speckle noise in PolSAR images and selects significant and uniformly distributed matching key points by threshold constraint, morphological erosion, and non-extreme value suppression. Further, in this paper, we design a Siamese simple dense capsule network (SimSD-CapsuleNet) to quickly extract the shallow texture features and deep semantic features of the data, and we use the polarization covariance matrix as the input data in order to make full use of the polarization information. In this paper, the distances between the capsule form feature descriptors are calculated and fed into a hard L2 loss function for the training of the model. The method in this paper is validated on PolSAR images acquired by different sensors with different resolutions, and the results show that the method can acquire more uniform and a larger number of matching key points in a shorter time, and the combination of PWF and deep neural network can achieve fast and accurate PolSAR image registration.

Key words: polarimetric synthetic aperture radar, PWF, CapsuleNet, PolSAR image registration, polarization covariance matrix

CLC Number:

P237

XIANG Deliang, DING Huaiyue, GUAN Dongdong, CHENG Jianda, SUN Xiaokun. PolSAR image registration combining polarization whitening filtering and SimSD-CapsuleNet[J]. Acta Geodaetica et Cartographica Sinica, 2024, 53(3): 450-462.

References

[1] XIANG Deliang, TANG Tao, BAN Yifang, et al. Unsupervised polarimetric SAR urban area classification based on model-based decomposition with cross scattering[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016, 116:86-100.
[2] CHENG Jianda, ZHANG Fan, XIANG Deliang, et al. PolSAR image classification with multiscale superpixel-based graph convolutional network[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60:3079438.
[3] XU Kunpeng, ZHAO Lei, LI Kun, et al. Estimation of crop biomass using GF-3 polarization SAR data based on genetic algorithm feature selection[J]. Journal of Geodesy and Geoinformation Science, 2020, 3(4):126-136.
[4] SURI S, REINARTZ P. Mutual-information-based registration of TerraSAR-X and IKONOS imagery in urban areas[J]. IEEE Transactions on Geoscience and Remote Sensing, 2010, 48(2):939-949.
[5] YOO J C, HAN T H. Fast normalized cross-correlation[J]. Circuits, Systems and Signal Processing, 2009, 28(6):819-843.
[6] WANG Fei, VEMURI B C. Non-rigid multi-modal image registration using cross-cumulative residual entropy[J]. International Journal of Computer Vision, 2007, 74(2):201-215.
[7] CORDÓN O, DAMAS S. Image registration with iterated local search[J]. Journal of Heuristics, 2006, 12(1):73-94.
[8] XUAN Yanyan, HUANG Yulin, YANG Jianyu. New approach for improving mutual information in POLSAR image registration[C]//Proceedings of 2010 International Conference on Signal Processing. Beijing:IEEE, 2010:853-856.
[9] LOWE D G. Object recognition from local scale-invariant features[C]//Proceedings of 1999 IEEE International Conference on Computer Vision. Kerkyra:IEEE, 1999:1150-1157.
[10] DELLINGER F, DELON J, GOUSSEAU Y, et al. SAR-SIFT:a SIFT-like algorithm for SAR images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(1):453-466.
[11] MA Wenping, WEN Zelian, WU Yue, et al. Remote sensing image registration with modified SIFT and enhanced feature matching[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(1):3-7.
[12] ZOU Bin, LI Haolin, ZHANG Lamei, et al. A SAR-SIFT like algorithm for PolSAR image registration[C]//Proceedings of 2019 Asia-Pacific Conference on Synthetic Aperture Radar. Xiamen:IEEE, 2019:1-5.
[13] 马文婷, 曲迪, 吴蔚, 等. 基于PWF的极化SAR图像匹配方法[J]. 指挥信息系统与技术, 2016, 7(2):63-67. MA Wenting, QU Di, WU Wei, et al. Image matching method for polarimetric SAR based on PWF[J]. Command Information System and Technology, 2016, 7(2):63-67.
[14] ZHANG Han, NI Weiping, YAN Weidong, et al. Registration of multimodal remote sensing image based on deep fully convolutional neural network[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, 12(8):3028-3042.
[15] XIANG Deliang, XU Yihao, CHENG Jianda, et al. Progressive keypoint detection with dense Siamese network for SAR image registration[J]. IEEE Transactions on Aerospace and Electronic Systems, 2023,59(5):1-12.
[16] 朱庆涛, 殷君君, 曾亮, 等. 基于邻域一致性的极化SAR图像仿射配准[J]. 雷达学报, 2021, 10(1):49-60. ZHU Qingtao, YIN Junjun, ZENG Liang, et al. Polarimetric SAR image affine registration based on neighborhood consensus[J]. Journal of Radars, 2021, 10(1):49-60.
[17] SABOUR S, FROSST N, HINTON G E. Dynamic routing between capsules[C]//Proceedings of 2017 International Conference on Neural Information Processing Systems. Long Beach:ACM Press, 2017:3859-3869.
[18] LI Bangjie, GUAN Dongdong, ZHENG Xiaolong, et al. SD-CapsNet:a siamese dense capsule network for SAR image registration with complex scenes[J]. Remote Sensing, 2023, 15(7):1871.
[19] FISCHLER M A, BOLLES R C. Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6):381-395.
[20] GOODMAN N R. Statistical analysis based on a certain multivariate complex Gaussian distribution (an introduction)[J]. The Annals of Mathematical Statistics, 1963, 34(1):152-177.
[21] GONCALVES H, CORTE-REAL L, GONCALVES J A. Automatic image registration through image segmentation and SIFT[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(7):2589-2600.
[22] YE Yuanxin, WANG Mengmeng, HAO Siyuan, et al. A novel keypoint detector combining corners and blobs for remote sensing image registration[J]. IEEE Geoscience and Remote Sensing Letters, 2021, 18(3):451-455.
[23] GOZE S, LOPES A. A MMSE speckle filter for full resolution SAR polarimetric data[J]. Journal of Electromagnetic Waves and Applications, 1993, 7(5):717-737.
[24] LOPES A, SERY F. Optimal speckle reduction for the product model in multilook polarimetric SAR imagery and the Wishart distribution[J].IEEE Transactions on Geoscience and Remote Sensing, 1997, 35(3):632-647.
[25] HUANG Gao, LIU Zhuang, VAN DER MAATEN L, et al. Densely connected convolutional networks[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition.Honolulu:IEEE, 2017:4700-4708.
[26] WANG Zhenyao, LIU Tonghai. Two-stage method based on triplet margin loss for pig face recognition[J]. Computers and Electronics in Agriculture, 2022, 194:106737.
[27] TIAN Yurun, YU Xin, FAN Bin, et al. SOSNet:second order similarity regularization for local descriptor learning[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach:IEEE, 2019:11016-11025.