利用多尺度特征与深度网络对遥感影像进行场景分类

doi:10.11947/j.AGCS.2016.20150623

摘要/Abstract

摘要： 针对因样本量小而导致的遥感图像场景分类精度不高的问题，结合非下采样Contourlet变换（NSCT）、深度卷积神经网络（DCNN）和多核支持向量机（MKSVM），提出了一种基于多尺度深度卷积神经网络（MS-DCNN）的遥感图像场景分类方法。首先利用非下采样Contourlet变换方法对遥感图像多尺度分解，然后对分解后的高频子带和低频子带分别用DCNN训练得到了不同尺度的图像特征，最后采用MKSVM综合多尺度特征并实现遥感图像场景分类。对标准遥感图像分类数据集的试验结果表明，本算法能够结合低频和高频子带对不同类别场景的识别优势，对遥感图像场景取得较好的分类结果。

关键词: 遥感图像, 场景分类, 深度卷积神经网络, 非下采样轮廓波变换, 多核支持向量机

Abstract: Aiming at low precision of remote sensing image scene classification owing to small sample sizes, a new classification approach is proposed based on multi-scale deep convolutional neural network (MS-DCNN), which is composed of nonsubsampled Contourlet transform (NSCT), deep convolutional neural network (DCNN), and multiple-kernel support vector machine (MKSVM). Firstly, remote sensing image multi-scale decomposition is conducted via NSCT. Secondly, the decomposing high frequency and low frequency subbands are trained by DCNN to obtain image features in different scales. Finally, MKSVM is adopted to integrate multi-scale image features and implement remote sensing image scene classification. The experiment results in the standard image classification data sets indicate that the proposed approach obtains great classification effect due to combining the recognition superiority to different scenes of low frequency and high frequency subbands.

Key words: remote sensing image, scene classification, deep convolutional neural network, nonsubsampled Contourlet transform, multiple-kernel support vector machine

中图分类号:

P237

许夙晖, 慕晓冬, 赵鹏, 马骥. 利用多尺度特征与深度网络对遥感影像进行场景分类[J]. 测绘学报, 2016, 45(7): 834-840.

XU Suhui, MU Xiaodong, ZHAO Peng, MA Ji. Scene Classification of Remote Sensing Image Based on Multi-scale Feature and Deep Neural Network[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(7): 834-840.

参考文献

[1] 李德仁, 张良培, 夏桂松. 遥感大数据自动分析与数据挖掘[J]. 测绘学报, 2014, 43(12):1211-1216. DOI:10.13485/j.cnki.11-2089.2014.0187. LI Deren, ZHANG Liangpei, XIA Guisong. Automatic Analysis and Mining of Remote Sensing Big Data[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(12):1211-1216. DOI:10.13485/j.cnki.11-2089.2014.0187.
[2] CHAN T H, JIA Kui, GAO Shenghua, et al. PCANet:A Simple Deep Learning Baseline for Image Classification[J]. IEEE Transactions on Image Processing, 2015, 24(12):5017-5032.
[3] 章锦文, 宋小春, 赵广州, 等. 桥梁目标识别方法综述[J]. 红外与激光工程, 2012, 41(12):3429-3435. ZHANG Jinwen,SONG Xiaochun,ZHAO Guangzhou,et al. Summary of Bridge Recognition Methods[J]. Infrared and Laser Engineering, 2012, 41(12):3429-3435.
[4] 赵理君, 唐娉, 霍连志, 等. 图像场景分类中视觉词包模型方法综述[J]. 中国图象图形学报, 2014, 19(3):333-343. ZHAO Lijun, TANG Ping, HUO Lianzhi, et al. Review of the Bag-of-visual-words Models in Image Scene Classification[J]. Journal of Image and Graphics, 2014, 19(3):333-343.
[5] 李昭慧, 张建奇. 城市街区星载光学遥感图像车辆目标自动检测方法[J]. 红外与激光工程, 2014, 43(11):3751-3755. LI Zhaohui, ZHANG Jianqi. Automatic Vehicle Detection Using Spaceborne Optical Remote Sensing Images in City Area[J]. Infrared and Laser Engineering, 2014, 43(11):3751-3755.
[6] SCHMIDHUBER J. Deep Learning in Neural Networks:An Overview[J]. Neural Networks, 2015, 61:85-117
[7] 郑胤, 陈权崎, 章毓晋. 深度学习及其在目标和行为识别中的新进展[J]. 中国图象图形学报, 2014, 19(2):175-184. ZHENG Yin, CHEN Quanqi, ZHANG Yujin. Deep Learning and Its New Progress in Object and Behavior Recognition[J]. Journal of Image and Graphics, 2014, 19(2):175-184.
[8] YAMASHITA T, WATASUE T. Hand Posture Recognition Based on Bottom-up Structured Deep Convolutional Neural Network with Curriculum Learning[C]//Proceedings of 2014 IEEE International Conference on Image Processing. Paris:IEEE, 2014:853-857.
[9] SMIRNOV E A, TIMOSHENKO D M, ANDRIANOV S N. Comparison of Regularization Methods for Image Net Classification with Deep Convolutional Neural Networks[J]. AASRI Procedia, 2014, 6:89-94.
[10] HE Kaiming, ZHANG Xiangyu, REN Shaoqing, et al. Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9):1904-1916.
[11] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Image Net Classification with Deep Convolutional Neural Networks[C]//Proceeding of the 26th Annual Conference on Neural Information Processing Systems. Lake Tahoe, California:Neural Information Processing Systems Foundation, Inc, 2012:1097-1105.
[12] CHEN Xueyun, XIANG Shiming, LIU Chenglin, et al. Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks[J]. IEEE Geoscience and Remote Sensing Letters, 2014, 11(10):1797-1801.
[13] NIU Xiaoxiao, SUEN C Y. A Novel Hybrid CNN-SVM Classifier for Recognizing Handwritten Digits[J]. Pattern Recognition, 2012, 45(4):1318-1325.
[14] SELTZER M L, DROPPO J. Multi-task Learning in Deep Neural Networks for Improved Phoneme Recognition[C]//Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing. Vancouver:IEEE, 2013:6965-6969.
[15] SPENCER M, EICKHOLTL J, CHENG Jianlin. A Deep Learning Network Approach to ab initio Protein Secondary Structure Prediction[J]. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2015, 12(1):103-112.
[16] 许妙忠, 丛铭, 万丽娟, 等. 视觉感受与Markov随机场相结合的高分辨率遥感影像分割法[J]. 测绘学报, 2015, 44(2):198-205. DOI:10.11947/j.AGCS.2015.20130453. XU Miaozhong, CONG Ming, WAN Lijuan, et al. A Methodology of Image Segmentation for High Resolution Remote Sensing Image Based on Visual System and Markov Random Field[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(2):198-205. DOI:10.11947/j.AGCS.2015.20130453.
[17] CUNHA A L D, ZHOU J, DO M N. The Nonsubsampled Contourlet Transform:Theory, Design, and Applications[J]. IEEE Transactions on Image Processing, 2006, 15(10):3089-3101.
[18] CHEN Zhenyu, LI Jianping, WEI Liwei, et al. Multiple-kernel SVM Based Multiple-task Oriented Data Mining System for Gene Expression Data Analysis[J]. Expert Systems with Applications, 2011, 38(10):12151-12159.
[19] ZHENG Xinwei, SUN Xian, FU Kun, et al. Automatic Annotation of Satellite Images via Multifeature Joint Sparse Coding with Spatial Relation Constraint[J]. IEEE Geoscience and Remote Sensing Letters, 2013, 10(4):652-656.
[20] ZHANG Fan, DU Bo, ZHANG Liangpei. Saliency-guided Unsupervised Feature Learning for Scene Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(4):2175-2184.
[21] YANG Yi, NEWSAM S. Bag-of-visual-words and Spatial Extensions for Land-use Classification[C]//Proceedings of the 18th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. New York:ACM, 2010:270-279.
[22] 刘扬, 付征叶, 郑逢斌. 基于认知神经计算模型的高分辨率遥感图像场景分类[J]. 系统工程与电子技术, 2015, 37(11):2623-2633. LIU Yang, FU Zhengye, ZHENG Fengbin. Scene Classification of High-resolution Remote Sensing Image Based on Multimedia Neural Cognitive Computing[J]. Systems Engineering and Electronics, 2015, 37(11):2623-2633.
[23] ZHAO Lijun, TANG Ping, HUO Lianzhi. Land-use Scene Classification Using a Concentric Circle-structured Multiscale Bag-of-visual-words Model[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014, 7(12):4620-4631.
[24] NOGUEIRA K, MIRANDA W O, SANTOS J A D. Improving Spatial Feature Representation from Aerial Scenes by Using Convolutional Networks[C]//Proceedings of the 201528th SIBGRAPI Conference on Graphics, Patterns and Images. Salvador:IEEE, 2015:289-296.
[25] CHENG Gong, ZHOU Peicheng, HAN Junwei, et al. Auto-encoder-based Shared Mid-level Visual Dictionary Learning for Scene Classification Using Very High Resolution Remote Sensing Images[J]. IET Computer Vision, 2015, 9(5):639-647.
[26] HU Fan, XIA Guisong, WANG Zifeng, et al. Unsupervised Feature Learning via Spectral Clustering of Multidimensional Patches for Remotely Sensed Scene Classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(5):2015-2030.
[27] CHERIYADAT A M. Unsupervised Feature Learning for Aerial Scene Classification[J]. IEEE Transactions on Geoscience Remote Sensing, 2014, 52(1):439-451.
[28] PERRONNIN F, SÁNCHEZ J, MENSINK T. Improving the Fisher Kernel for Large-scale Image Classification[C]//Proceedings of the 11th European Conference on Computer Vision. Berlin Heidelberg:Springer, 2010:143-156.