多层特征与上下文信息相结合的光学遥感影像目标检测

doi:10.11947/j.AGCS.2019.20180431

测绘学报 ›› 2019, Vol. 48 ›› Issue (10): 1275-1284.doi: 10.11947/j.AGCS.2019.20180431

多层特征与上下文信息相结合的光学遥感影像目标检测

陈丁, 万刚, 李科

信息工程大学, 河南郑州 450001

收稿日期:2018-09-13 修回日期:2019-02-27 出版日期:2019-10-20 发布日期:2019-10-24
通讯作者: 李科 E-mail:like19771223@163.com
作者简介:陈丁(1990-),男,博士生,研究方向为遥感影像分析和虚拟地理环境。E-mail:fwind_email@163.com
基金资助:
国家自然科学基金（41871322）；国家国防基金项目（3601015）

Object detection in optical remote sensing images based on combination of multi-layer feature and context information

CHEN Ding, WAN Gang, LI Ke

Information Engineering University, Zhengzhou 450001, China

Received:2018-09-13 Revised:2019-02-27 Online:2019-10-20 Published:2019-10-24
Supported by:
The National Natural Science Foundation of China (No. 41871322);National Defense Foundation of China (No. 3601015)

摘要/Abstract

摘要： 目标检测是遥感影像分析的基础和关键。针对光学遥感影像中目标尺度多样、小目标居多、相似性及背景复杂等问题，本文提出一种将卷积神经网络（CNN）和混合波尔兹曼机（HRBM）相结合的遥感影像目标检测方法。首先设计细节—语义特征融合网络（D-SFN）提取卷积神经网络低层和高层融合特征，提升目标特征的判别力，特别是小目标；其次考虑上下文信息对目标检测的影响，结合上下文信息进一步加强目标表征的准确性，提升检测精度。在NWPU数据集上试验表明，本文方法能够显著提升目标检测精度且具有一定程度的稳健性。

关键词: 遥感影像, 目标检测, 卷积神经网络, 受限玻尔兹曼机

Abstract: Object detection is the basic and key step of remote sensing image analysis. In optical remote sensing images, object detection faced many challenges such as multi-scale and small objects, appearance ambiguity and complicated background. To address these problems, a new method of object detection based on convolutional neural networks (CNN) and hybrid restricted boltzmann machine (HRBM) is proposed. Firstly, the detail-semantic feature fusion network (D-SFN) is designed to extract fusion features from low-level and high-level CNNs, which can make the target representation more distinguishable, especially for small objects. Secondly, context information is incorporated to further boost feature discrimination, which also improves the detection accuracy. Experiments on NWPU datasets show that the proposed method can significantly improve the accuracy of object detection and has certain robustness.

Key words: remote sensing images, object detection, CNN, RBM

中图分类号:

P237

陈丁, 万刚, 李科. 多层特征与上下文信息相结合的光学遥感影像目标检测[J]. 测绘学报, 2019, 48(10): 1275-1284.

CHEN Ding, WAN Gang, LI Ke. Object detection in optical remote sensing images based on combination of multi-layer feature and context information[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(10): 1275-1284.

参考文献 26

[1]	温奇, 李苓苓, 刘庆杰, 等. 基于视觉显著性和图分割的高分辨率遥感影像中人工目标区域提取[J]. 测绘学报, 2013, 42(6):831-837. WEN Qi, LI Lingling, LIU Qingjie, et al. A man-made object area extraction method based on visual saliency detection and graph-cut segmentation for high resolution remote sensing imagery[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(6):831-837.
[2]	GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH:IEEE, 2014:580-587.
[3]	GIRSHICK R. Fast R-CNN[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago:IEEE, 2015:1440-1448.
[4]	REN Shaoqing, HE Kaiming, GIRSHICK R, et al. Faster R-CNN:towards real-time object detection with region proposal networks[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems. Cambridge, MA:MIT Press, 2015:91-99.
[5]	REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once:unified, real-time object detection[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV:IEEE, 2016:779-788.
[6]	LIU Wei, ANGUELOV D, ERHAN D, et al. SSD:single shot multibox detector[C]//Proceedings of the 14th European Conference on Computer Vision. Amsterdam:Springer, 2016:21-37.
[7]	EVERINGHAM M, VAN GOOL L, WILLIAMS C K I, et al. The Pascal visual object classes (VOC) challenge[J]. International Journal of Computer Vision, 2010, 88(2):303-338.
[8]	CHENG Gong, HAN Junwei, ZHOU Peicheng, et al. Multi-class geospatial object detection and geographic image classification based on collection of part detectors[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014, 98(12):119-132.
[9]	伍广明, 陈奇, SHIBASAKI R, 等. 基于U形卷积神经网络的航空影像建筑物检测[J]. 测绘学报, 2018, 47(6):864-872. DOI:10.11947/j.AGCS.2018.20170651. WU Guangming, CHEN Qi, SHIBASAKI R, et al. High precision building detection from aerial imagery using a U-Net like convolutional architecture[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(6):864-872. DOI:10.11947/j.AGCS.2018.20170651.
[10]	戴玉超, 张静, PORIKLI F, 等. 深度残差网络的多光谱遥感图像显著目标检测[J]. 测绘学报, 47(6):873-881. DOI:10.11947/j.AGCS.2018.20170633. DAI Yuchao, ZHANG Jing, PORIKLI F, et al. Salient object detection from multi-spectral remote sensing images with deep residual network[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(6):873-881. DOI:10.11947/j.AGCS.2018.20170633.
[11]	XU Yuelei, ZHU Mingming, XIN Peng, et al. Rapid airplane detection in remote sensing images based on multilayer feature fusion in fully convolutional neural networks[J]. Sensors, 2018, 18(7):2335.
[12]	YANG Yiding, ZHUANG Yin, BI Fukun, et al. M-FCN:effective fully convolutional network-based airplane detection framework[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(8):1293-1297.
[13]	TANG Tianyu, ZHOU Shilin, DENG Zhipeng, et al. Vehicle detection in aerial images based on region convolutional neural networks and hard negative example mining[J]. Sensors, 2017, 17(2):336.
[14]	GUO Wei, YANG Wen, ZHANG Haijian, et al. Geospatial object detection in high resolution satellite images based on multi-scale convolutional neural network[J]. Remote Sensing, 2018, 10(1):131.
[15]	CHEN Zhong, ZHANG Ting, OUYANG Chao. End-to-end airplane detection using transfer learning in remote sensing images[J]. Remote Sensing, 2018, 10(1):139.
[16]	LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA:IEEE, 2015:3431-3440.
[17]	UIJLINGS J R R, VAN DE SANDE K E A, GEVERS T, et al. Selective search for object recognition[J]. International Journal of Computer Vision, 2013, 104(2):154-171.
[18]	ZEILER M D, FERGUS R. Visualizing and understanding convolutional networks[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich:Springer, 2014:818-833.
[19]	ZITNICK C L, DOLLÁR P. Edge boxes:locating object proposals from edges[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich:Springer, 2014:391-405.
[20]	KUO Weicheng, HARIHARAN B, MALIK J. DeepBox:learning objectness with convolutional networks[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago:IEEE, 2015:2479-2487.
[21]	WANG Li, LU Yao, WANG Hong, et al. Evolving boxes for fast vehicle detection[C]//Proceedings of 2017 IEEE International Conference on Multimedia and Expo. Hong Kong, China:IEEE, 2017:1135-1140.
[22]	HINTON G E, OSINDERO S, TEH Y W. A fast learning algorithm for deep belief nets[J]. Neural Computation, 2006, 18(7):1527-1554.
[23]	LAROCHELLE H, MANDEL M, PASCANU R, et al. Learning algorithms for the classification restricted Boltzmann machine[J]. Journal of Machine Learning Research, 2012, 13(1):643-669.
[24]	KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe:ACM, 2012:1097-1105.
[25]	FELZENSZWALB P F, GIRSHICK R B, MCALLESTER D, et al. Object detection with discriminatively trained part-based models[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(9):1627-1645.
[26]	CHENG Gong, ZHOU Peicheng, HAN Junwei. Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(12):7405-7415.

多层特征与上下文信息相结合的光学遥感影像目标检测

Object detection in optical remote sensing images based on combination of multi-layer feature and context information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献 26

相关文章 15

编辑推荐

Metrics

本文评价

[1]	张祖勋, 姜慧伟, 庞世燕, 胡翔云. 多时相遥感影像的变化检测研究现状与展望[J]. 测绘学报, 2022, 51(7): 1091-1107.
[2]	李荣兴, 李国君, 冯甜甜, 沈强, 乔刚, 叶真, 夏梦莲. 基于光学遥感卫星影像的南极冰流速产品和方法研究综述[J]. 测绘学报, 2022, 51(6): 953-963.
[3]	程结海, 黄中意, 王建如, 何湜. 高空间分辨率遥感影像最优分割结果自动确定方法[J]. 测绘学报, 2022, 51(5): 658-667.
[4]	白坤, 慕晓冬, 陈雪冰, 朱永清, 尤轩昂. 融合半监督学习的无监督遥感影像场景分类[J]. 测绘学报, 2022, 51(5): 691-702.
[5]	李景文, 韦晶闪, 姜建武, 陆妍玲, 刘垒, 唐一飞, 李旭. 多视角监控视频中动态目标的时空信息提取方法[J]. 测绘学报, 2022, 51(3): 388-400.
[6]	廖章回, 姜闯. 高分辨率遥感影像快速去雾[J]. 测绘学报, 2022, 51(3): 446-456.
[7]	何直蒙, 丁海勇, 安炳琪. 高分辨率遥感影像建筑物提取的空洞卷积E-Unet算法[J]. 测绘学报, 2022, 51(3): 457-467.
[8]	洪亮, 冯亚飞, 彭双云, 楚森森. 面向对象的多尺度加权联合稀疏表示的高空间分辨率遥感影像分类[J]. 测绘学报, 2022, 51(2): 224-237.
[9]	葛小三, 陈曦, 赵文智, 李瑞祥. 基于生成对抗网络的建筑物损毁检测[J]. 测绘学报, 2022, 51(2): 238-247.
[10]	余俊鹏, 吴伟东, 孙佳明, 满益云, 沈刚. 附加傅里叶补偿项的卫星遥感影像RFM平差方法[J]. 测绘学报, 2022, 51(1): 127-134.
[11]	张玉鑫, 颜青松, 邓非. 高分辨率遥感影像建筑物提取多路径RSU网络法[J]. 测绘学报, 2022, 51(1): 135-144.
[12]	龚健雅, 许越, 胡翔云, 姜良存, 张觅. 遥感影像智能解译样本库现状与研究[J]. 测绘学报, 2021, 50(8): 1013-1022.
[13]	陶超, 阴紫薇, 朱庆, 李海峰. 遥感影像智能解译:从监督学习到自监督学习[J]. 测绘学报, 2021, 50(8): 1122-1134.
[14]	杨秋莲, 刘艳飞, 丁乐乐, 孟凡效. 高分影像场景分类的半监督深度卷积神经网络学习方法[J]. 测绘学报, 2021, 50(7): 930-938.
[15]	叶发茂, 孟祥龙, 董萌, 聂运菊, 葛芸, 陈晓勇. 遥感图像蚁群算法和加权图像到类距离检索法[J]. 测绘学报, 2021, 50(5): 612-620.