多尺度全卷积神经网络建筑物提取

doi:10.11947/j.AGCS.2019.20180062

测绘学报 ›› 2019, Vol. 48 ›› Issue (5): 597-608.doi: 10.11947/j.AGCS.2019.20180062

多尺度全卷积神经网络建筑物提取

崔卫红, 熊宝玉, 张丽瑶

武汉大学遥感信息工程学院, 湖北武汉 430079

收稿日期:2018-02-10 修回日期:2018-07-23 出版日期:2019-05-20 发布日期:2019-06-05
通讯作者: 熊宝玉 E-mail:xiongbbyy@foxmail.com
作者简介:崔卫红(1971-),女,博士,副教授,研究方向为遥感影像信息提取与变化检测。E-mail:whcui@whu.edu.cn
基金资助:
国家自然科学基金（41101410）

Multi-scale fully convolutional neural network for building extraction

CUI Weihong, XIONG Baoyu, ZHANG Liyao

School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China

Received:2018-02-10 Revised:2018-07-23 Online:2019-05-20 Published:2019-06-05
Supported by:
The National Natural Science Foundation of China (No.41101410)

摘要/Abstract

摘要： 针对VGG16网络在高空间分辨率遥感影像中进行大型建筑物提取时存在空洞的现象，提出一种基于多尺度影像的建筑物提取方法。将原始影像进行不同尺度的下采样，提取不同尺度下的建筑物特征，并将这些多尺度特征相加合并，同时为了减少网络参数数量，用全卷积上采样过程代替原始VGG16网络中的全连接层进行建筑物提取。以0.5 m分辨率的上海市嘉定区影像和1 m分辨率的Massachusetts地区影像进行试验，精度分别达97.09%和96.66%，表明本文方法的有效性。

关键词: 大型建筑物, 多尺度, 全卷积上采样

Abstract: Some holes occurred when extracting large buildings in high spatial resolution remote sensing images with VGG16. A method of building extraction based on multi-scale features is proposed to solve this problem. Firstly, the original images were downsampled at different scales. Then, it could be extracted that the features of buildings at different scales and fused them. To reduce the number of network parameters, the fully convolutional upsampling was used to replace the fully connected layer in the original VGG16 model. The study images were from the 0.5 m resolution in Jading of Shanghai and 1 m resolution Massachusetts building dataset. The accuracy of buildings extraction were 97.09% and 96.66% respectively. The result showed the effectiveness of the proposed method.

Key words: large buildings, multi-scale, fully convolutional upsampling

中图分类号:

TP79
P237

崔卫红, 熊宝玉, 张丽瑶. 多尺度全卷积神经网络建筑物提取[J]. 测绘学报, 2019, 48(5): 597-608.

CUI Weihong, XIONG Baoyu, ZHANG Liyao. Multi-scale fully convolutional neural network for building extraction[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(5): 597-608.

参考文献

[1] JIN Xiaoying, DAVIS C H. Automated building extraction from high-resolution satellite imagery in urban areas using structural, contextual, and spectral information[J]. EURASIP Journal on Advances in Signal Processing, 2005(2005):745309.
[2] PESARESI M, GERHARDINGER A, KAYITAKIRE F. A robust built-up area presence index by anisotropic rotation-invariant textural measure[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2008, 1(3):180-192.
[3] SIRMACEK B, UNSALAN C. A probabilistic framework to detect buildings in aerial and satellite images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(1):211-221.
[4] HARRIS C, STEPHENS M. A combined corner and edge detector[C]//Proceedings of the 4th Alvey Vision Conference. Manchester:BMVA, 1988:147-151.
[5] UNSALAN C. Gradient-magnitude-based support regions in structural land use classification[J]. IEEE Geoscience and Remote Sensing Letters, 2006, 3(4):546-550.
[6] WANG Jun, YANG Xiucheng, QIN Xuebin, et al. An efficient approach for automatic rectangular building extraction from very high resolution optical satellite imagery[J]. IEEE Geoscience and Remote Sensing Letters, 2015, 12(3):487-491.
[7] AKINLAR C, TOPAL C. EDLines:A real-time line segment detector with a false detection control[J]. Pattern Recognition Letters, 2011, 32(13):1633-1642.
[8] 吕凤华, 舒宁, 龚龑, 等. 利用多特征进行航空影像建筑物提取[J]. 武汉大学学报(信息科学版), 2017, 42(5):656-660. LÜ Fenghua, SHU Ning, GONG Yan, et al. Regular building extraction from high resolution image based on multilevel-features[J]. Geomatics and Information Science of Wuhan University, 2017, 42(5):656-660.
[9] HUANG Xin, ZHANG Liangpei. A multidirectional and multiscale morphological index for automatic building extraction from multispectral GeoEye-1 imagery[J]. Photogrammetric Engineering & Remote Sensing, 2011, 77(7):721-732.
[10] 胡荣明, 黄小兵, 黄远程. 增强形态学建筑物指数应用于高分辨率遥感影像中建筑物提取[J]. 测绘学报, 2014, 43(5):514-520. DOI:10.13485/j.cnki.11-2089.2014.0084. HU Rongming, HUANG Xiaobing, HUANG Yuancheng. An enhanced morphological building index for building extraction from high-resolution image[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(5):514-520. DOI:10.13485/j.cnki.11-2089.2014.0084.
[11] 林祥国, 张继贤. 面向对象的形态学建筑物指数及其高分辨率遥感影像建筑物提取应用[J]. 测绘学报, 2017, 46(6):724-733. DOI:10.11947/j.AGCS.2017.20170068. LIN Xiangguo, ZHANG Jixian. Object-based morphological building index for building extraction from high resolution remote sensing imagery[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(6):724-733. DOI:10.11947/j.AGCS.2017.20170068.
[12] MNIH V. Machine learning for aerial image labeling[D]. Toronto:University of Toronto, 2013.
[13] SAITO S, YAMASHITA T, AOKI Y. Multiple object extraction from aerial imagery with convolutional neural networks[J]. Journal of Imaging Science and Technology, 2016, 60(1):10402-1-10402-9.
[14] MAGGIORI E, TARABALKA Y, CHARPIAT G, et al. Convolutional neural networks for large-scale remote-sensing image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(2):645-657.
[15] LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA:IEEE, 2015:3431-3440.
[16] MARCU A, LEORDEANU M. Dual local-global contextual pathways for recognition in aerial imagery[R/OL]. (2016-05-12)[2017-08-13]. https://sciencewise.info/articles/1605.05462.
[17] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, Nevada:ACM, 2012:1097-1105.
[18] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[C]//Proceedings of International Conference on Learning Representations 2015. San Diego:ICLR, 2015:463-476.
[19] LIU Wei, ANGUELOV D, ERHAN D, et al. SSD:single shot multi box detector[C]//Proceedings of the 14th European Conference on Computer Vision. Amsterdam:Springer, 2016:21-37.
[20] ZHAO Hengshuang, SHI Jianping, QI Xiaojuan, et al. Pyramid scene parsing network[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI:IEEE, 2017:6230-6239.
[21] HE Kaiming, ZHANG Xiangyu, REN Shaoqing, et al. Deep residual learning for image recognition[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV:IEEE, 2016:770-778.
[22] CHEN L C, PAPANDREOU G, KOKKINOS I, et al. DeepLab:semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(4):834-848.
[23] FARABET C, COUPRIE C, NAJMAN L, et al. Learning hierarchical features for scene labeling[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(8):1915-1929.
[24] LIN Guosheng, SHEN Chunhua, VAN DEN HENGEL A, et al. Efficient piecewise training of deep structured models for semantic segmentation[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV:IEEE, 2016:3194-3203.
[25] CHEN L C, YANG Yi, WANG Jiang, et al. Attention to scale:scale-aware semantic image segmentation[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV:IEEE, 2016:3640-3649.
[26] BADRINARAYANAN V, KENDALL A, CIPOLLA R. SegNet:a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12):2491-2495.
[27] DENG Jia, DONG Wei, SOCHER R, et al. ImageNet:a large-scale hierarchical image database[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Miami Beach, FL:IEEE, 2009:248-255.
[28] BISHOP C M. Neural networks for pattern recognition[M]. Oxford:Oxford University Press, 1995.

多尺度全卷积神经网络建筑物提取

Multi-scale fully convolutional neural network for building extraction

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	张新长, 何显锦, 孙颖, 黄健锋, 张志强. 多尺度空间数据联动更新技术研究现状及展望[J]. 测绘学报, 2022, 51(7): 1520-1535.
[2]	艾廷华, 张翔. 地理信息科学中尺度概念的诠释与表达[J]. 测绘学报, 2022, 51(7): 1640-1652.
[3]	梁哲恒, 黎宵, 邓鹏, 盛森, 姜福泉. 融合多尺度特征注意力的遥感影像变化检测方法[J]. 测绘学报, 2022, 51(5): 668-676.
[4]	孙伟伟, 常明会, 孟祥超, 杨刚, 任凯. 空谱协同多尺度顶点成分分析的高光谱影像端元提取[J]. 测绘学报, 2022, 51(4): 587-598.
[5]	洪亮, 冯亚飞, 彭双云, 楚森森. 面向对象的多尺度加权联合稀疏表示的高空间分辨率遥感影像分类[J]. 测绘学报, 2022, 51(2): 224-237.
[6]	邓敏, 谌恺祺, 石岩, 陈袁芳, 郭艺文. 多尺度空间同位模式挖掘的点过程分解方法[J]. 测绘学报, 2022, 51(2): 258-268.
[7]	高晓蓉, 闫浩文, 禄小敏. 多尺度地图空间居民地语义相似度计算方法[J]. 测绘学报, 2022, 51(1): 95-103.
[8]	张玉鑫, 颜青松, 邓非. 高分辨率遥感影像建筑物提取多路径RSU网络法[J]. 测绘学报, 2022, 51(1): 135-144.
[9]	叶健, 胡鑫, 徐鸿蒙, 陈曦, 吕琦. 多尺度GTWR城市住宅价格建模与分析[J]. 测绘学报, 2021, 50(9): 1266-1274.
[10]	李静, 刘海砚, 郭文月, 陈欣. 基于深度学习的人群活动流量时空预测模型[J]. 测绘学报, 2021, 50(4): 522-531.
[11]	续东, 柳景斌, 花向红, 陶武勇. 道路空间特征与测量距离相结合的LiDAR道路边界点提取算法[J]. 测绘学报, 2021, 50(11): 1534-1545.
[12]	刘鹏程, 肖天元, 肖佳, 艾廷华. 曲线多尺度表达的Head-Tail信息量分割法[J]. 测绘学报, 2020, 49(7): 921-933.
[13]	赵传, 郭海涛, 卢俊, 余东行, 张保明. 基于深度残差网络的机载LiDAR点云分类[J]. 测绘学报, 2020, 49(2): 202-213.
[14]	赵泉华, 谢凯浪, 王光辉, 李玉. 全卷积网络和条件随机场相结合的全极化SAR土地覆盖分类[J]. 测绘学报, 2020, 49(1): 65-78.
[15]	姚群力, 胡显, 雷宏. 基于多尺度融合特征卷积神经网络的遥感图像飞机目标检测[J]. 测绘学报, 2019, 48(10): 1266-1274.