全卷积网络和条件随机场相结合的全极化SAR土地覆盖分类

doi:10.11947/j.AGCS.2020.20190038

测绘学报 ›› 2020, Vol. 49 ›› Issue (1): 65-78.doi: 10.11947/j.AGCS.2020.20190038

全卷积网络和条件随机场相结合的全极化SAR土地覆盖分类

赵泉华¹, 谢凯浪¹, 王光辉², 李玉¹

1. 辽宁工程技术大学测绘与地理科学学院遥感科学与应用研究所, 辽宁阜新 123000;
2. 自然资源部国土卫星遥感应用中心, 北京 100048

收稿日期:2019-01-21 修回日期:2019-08-03 发布日期:2020-01-16
作者简介:赵泉华(1978-),女,博士,教授,研究方向为遥感图像建模与分析、随机几何在遥感图像处理中的应用。E-mail:zqhlby@163.com
基金资助:
国家自然科学基金（41271435；41301479）；辽宁省高校创新人才支持计划（LR2016061）

Land cover classification of polarimetric SAR with fully convolution network and conditional random field

ZHAO Quanhua¹, XIE Kailang¹, WANG Guanghui², LI Yu¹

1. Institute for Remote Sensing Science and Application, School of Geomatics, Liaoning Technical University, Fuxin 123000, China;
2. Land Satellite Remote Sensing Application Center, Beijing 100048, China

Received:2019-01-21 Revised:2019-08-03 Published:2020-01-16
Supported by:
The National Natural Science Foundation of China (Nos. 41271435;41301479);University Innovation Talent Support Program of Liaoning Province (No. LR2016061)

摘要/Abstract

摘要： 针对经典全卷积网络（fully convolution network，FCN）分类精度低、效果差，以及传统的极化合成孔径雷达（PolSAR）土地覆盖分类方法未充分考虑地物散射特性的问题，提出了一种结合改进FCN和条件随机场（conditional random field，CRF）的全极化SAR土地覆盖分类算法。首先，利用Freeman分解和Pauli分解建模全极化SAR影像，同时提取各分解对应的散射特征，参考Freeman分解散射功率获取其主散射分量对应的主散射地物；同时，借鉴在图像分类领域中具有卓越表现的FCN-Vgg19-8s网络，考虑其高层卷积参数量大和低层卷积模型参数优化程度不足，通过在高层和中层分别构建多尺度卷积组和代价函数设计了FCN-MD-8s网络，保证对整体模型参数进行降维和优化；以Freeman分解散射机理特征为基准，采用级连式迁移学习结构，实现FCN-MD-8s网络的模型训练和测试；然后，根据主散射分量所对应的主散射地物，在各分量预测图中提取出主特征地物，得到分量地物分类结果，并将其进行叠加得到全局粗分类；最后，利用全连接CRF结合Pauli相干分解重建假彩色图，对全局粗分类进行全局像素类别转移获得细分类结果。通过对分类结果定性和定量分析，可知提出算法具有有效性和可行性。

关键词: 目标分解, 全卷积网络, 条件随机场, 多尺度卷积组, 双代价收敛

Abstract: Aiming at the problems of low classification accuracy and poor effect in the traditional fully convolution network (FCN), and insufficient consideration on the scattering characteristics of ground object features in the traditional polarimetric synthetic aperture radar (PolSAR) land cover classification methods. To overcome this limitation, this paper proposes a land cover classification algorithm of polarimetric SAR with improved FCN and conditional random field (CRF). First of all, the Freeman and Pauli decompositions are used to model the full-polarimetric SAR image to obtain the scattering features of scattering mechanisms, and Freeman decompositions are referenced to obtain the main scattering object corresponding to the main scattering component. Learning from the FCN-Vgg19-8s network with excellent performance in the field of image classification, and considering the large amount of high-level convolution parameters and the insufficient optimization of low-level convolution model parameters, Then an improved FCN, named FCN-MD-8s, is designed though constructing multi-scale convolution group and cost function in the upper and middle layers based on FCN-Vgg19-8s to guarante dimensionality reduction and optimization of overall model parameters. Additionally, FCN-MD-8s network is trained and tested for scattering mechanisms from Freeman decomposition by Cascade-migration-learning structure. Afterwards, according to the main scattering feature corresponding to the main scattering component, the main feature object is extracted from each component prediction image to obtain a component classification result. The result of each component classification is superimposed to gain a global rough classification. Finally, the fully-connected CRF with false color image, which is visualized by Pauli coherent decomposition, is used to transfer full image information over global rough classification for fine classification. The qualitative and quantitative analyses of classification results demonstrate that the proposed algorithm has effectiveness and feasibility.

Key words: target decomposition, fully convolution network, conditional random field, multi-scale convolution group, double-cost convergence

中图分类号:

P237

赵泉华, 谢凯浪, 王光辉, 李玉. 全卷积网络和条件随机场相结合的全极化SAR土地覆盖分类[J]. 测绘学报, 2020, 49(1): 65-78.

ZHAO Quanhua, XIE Kailang, WANG Guanghui, LI Yu. Land cover classification of polarimetric SAR with fully convolution network and conditional random field[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(1): 65-78.

参考文献

[1] 朱永森, 曾永年, 张猛. 基于HJ卫星数据与面向对象分类的土地利用/覆盖信息提取[J]. 农业工程学报, 2017, 33(14):258-265. ZHU Yongsen, ZENG Yongnian, ZHANG Meng. Extract of land use/cover information based on HJ satellites data and object-oriented classification[J]. Transactions of the Chinese Society of Agricultural Engineering, 2017, 33(14):258-265.
[2] JIN Suming, YANG Limin, ZHU Zhe, et al. A land cover change detection and classification protocol for updating Alaska NLCD 2001 to 2011[J]. Remote Sensing of Environment, 2017(195):44-55.
[3] ANDREW M E, WULDER M A, NELSON T A. Potential contributions of remote sensing to ecosystem service assessments[J]. Progress in Physical Geography:Earth and Environment, 2014, 38(3):328-353.
[4] HUANG Huabing, CHEN Yanlei, CLINTON N, et al. Mapping major land cover dynamics in Beijing using all Landsat images in google earth engine[J]. Remote Sensing of Environment, 2017(202):166-176.
[5] CLOUDE S R, POTTIER E. An entropy based classification scheme for land applications of polarimetric SAR[J]. IEEE Transactions on Geoscience and Remote Sensing, 1997, 35(1):68-78.
[6] LEE J S, GRUNES M R, POTTIER E, et al. Unsupervised terrain classification preserving polarimetric scattering characteristics[J]. IEEE Transactions on Geoscience and Remote Sensing, 2004, 42(4):722-731.
[7] DABBOOR M, HOWELL S, SHOKR M, et al. The Jeffries-matusita distance for the case of complex Wishart distribution as a separability criterion for fully polarimetric SAR data[J]. International Journal of Remote Sensing, 2014, 35(19):6859-6873.
[8] LUMSDON P, CLOUDE S R, WRIGHT G. Polarimetric classification of land cover for glen Affric radar project[J]. IEE Proceedings-Radar, Sonar and Navigation, 2005, 152(6):404-412.
[9] 赵泉华, 郭世波, 李晓丽, 等. 利用目标分解特征的全极化SAR海冰分类[J]. 测绘学报, 2018, 47(12):1609-1620. DOI:10.11947/j.AGCS.2018.20170551. ZHAO Quanhua, GUO Shibo, LI Xiaoli, et al. Polarimetric SAR sea ice classification based on target decompositional features[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(12):1609-1620. DOI:10.11947/j.AGCS.2018.20170551.
[10] 赵磊. 基于谱图分割的极化SAR影像面向对象分类方法研究[D]. 北京:中国林业科学研究院, 2014. ZHAO Lei. Object-based classification of polarimetric SAR images based on spectral graph partitioning[D]. Beijing:Chinese Academy of Forestry, 2014.
[11] HABIBI M, SAHEBI M R, MAGHSOUDI Y, et al. Classification of polarimetric SAR data based on object-based multiple classifiers for urban land-cover[J]. Journal of the Indian Society of Remote Sensing, 2016, 44(6):855-863.
[12] LI H T, GU Haiyan, HAN Y S, et al. Object-oriented classification of polarimetric SAR imagery based on statistical region merging and support vector machine[C]//Proceedings of 2008 International Workshop on Earth Observation and Remote Sensing Applications. Beijing, China:IEEE, 2008:1-6.
[13] LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 1998, 86(11):2278-2324.
[14] RUSSAKOVSKY O, DENG Jia, SU Hao, et al. ImageNet large scale visual recognition challenge[J]. International Journal of Computer Vision, 2015, 115(3):211-252.
[15] ZHANG Zhimian, WANG Haipeng, XU Feng, et al. Complex-valued convolutional neural network and its application in polarimetric SAR image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(12):7177-7188.
[16] ZHOU Yu, WANG Haipeng, XU Feng, et al. Polarimetric SAR image classification using deep convolutional neural networks[J]. IEEE Geoscience and Remote Sensing Letters, 2016, 13(12):1935-1939.
[17] WANG Lei, XU Xin, DONG Hao, et al. Multi-pixel simultaneous classification of PolSAR image using convolutional neural networks[J]. Sensors, 2018, 18(3):E769.
[18] HARIHARAN B, ARBELÁEZ P, GIRSHICK R, et al. Simultaneous detection and segmentation[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland:Springer, 2014:297-312.
[19] SHELHAMER E, LONG J, DARRELL T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 39(4):640-651.
[20] KRÄHENBÜHL P, KOLTUN V. Efficient inference in fully connected CRFs with Gaussian edge potentials[C]//Proceedings of the 24th International Conference on Neural Information Processing Systems. Granada, Spain:Curran Associates Inc., 2011:109-117.
[21] ZHONG Ping, WANG Runsheng. Modeling and classifying hyperspectral imagery by CRFs with sparse higher order potentials[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(2):688-705.
[22] ZHOU Hao, ZHANG Jun, LEI Jun, et al. Image semantic segmentation based on FCN-CRF Model[C]//Proceedings of 2016 International Conference on Image, Vision and Computing. Portsmouth, UK:IEEE, 2016:9-14.
[23] CLOUDE S R, POTTIER E. A review of target decomposition theorems in radar polarimetry[J]. IEEE Transactions on Geoscience and Remote Sensing, 1996, 34(2):498-518.
[24] DENG Xinping, LÓPEZ-MARTÍNEZ C, CHEN Jinsong, et al. Statistical modeling of polarimetric SAR data:a survey and challenges[J]. Remote Sensing, 2017, 9(4):348.
[25] LEE J S, GRUNES M R, DE GRANDI G. Polarimetric SAR speckle filtering and its implication for classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(5):2363-2373.
[26] FREEMAN A, DURDEN S L. Three-component scattering model to describe polarimetric SAR data[C]//Proceedings of SPIE 1748, Radar Polarimetry. San Diego, CA:SPIE, 1993:213-224.
[27] 龙满生, 欧阳春娟, 刘欢, 等. 基于卷积神经网络与迁移学习的油茶病害图像识别[J]. 农业工程学报, 2018, 34(18):194-201. LONG Mansheng, OUYANG Chunjuan, LIU Huan, et al. Image recognition of camellia Oleifera diseases based on convolutional neural network & transfer learning[J]. Transactions of the Chinese Society of Agricultural Engineering, 2018, 34(18):194-201.
[28] CAO Fang, HONG Wen, POTTIER E. An improvement for the unsupervised Wishart freeman classification with fully Polarimetric SAR data[C]//Proceedings of 2010 IEEE International Geoscience and Remote Sensing Symposium. Honolulu, HI:IEEE, 2010:320-322.
[29] DALAL N, TRIGGS B. Histograms of oriented gradients for human detection[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego, CA:IEEE, 2005:886-893.
[30] ZHENG Shuai, JAYASUMANA S, ROMERA-PAREDES B, et al. Conditional random fields as recurrent neural networks[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile:IEEE, 2015:1529-1537.

全卷积网络和条件随机场相结合的全极化SAR土地覆盖分类

Land cover classification of polarimetric SAR with fully convolution network and conditional random field

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 6

编辑推荐

Metrics

本文评价

[1]	耿艳磊, 陶超, 沈靖, 邹峥嵘. 高分辨率遥感影像语义分割的半监督全卷积网络法[J]. 测绘学报, 2020, 49(4): 499-508.
[2]	魏立飞, 余铭, 钟燕飞, 袁自然, 黄灿. 空-谱融合的条件随机场高光谱影像分类方法[J]. 测绘学报, 2020, 49(3): 343-354.
[3]	左宗成, 张文, 张东映. 融合可变形卷积与条件随机场的遥感影像语义分割方法[J]. 测绘学报, 2019, 48(6): 718-726.
[4]	赵泉华, 郭世波, 李晓丽, 李玉. 利用目标分解特征的全极化SAR海冰分类[J]. 测绘学报, 2018, 47(12): 1609-1620.
[5]	何鄂龙, 王红平, 陈奇, 刘修国. 一种改进的空间上下文点云分类方法[J]. 测绘学报, 2017, 46(3): 362-370.
[6]	王少宇, 焦洪赞, 钟燕飞. 条件随机场模型约束下的遥感影像模糊C-均值聚类算法[J]. 测绘学报, 2016, 45(12): 1441-1447.