Progress and challenges of geospatial artificial intelligence

doi:10.11947/j.AGCS.2021.20200420

Abstract

Abstract: With the rapid development of geospatial science, artificial intelligence, and high-performance computing, geospatial artificial intelligence has become the major technique for processing and analyzing geospatial big data, and will be widely used in the scientific research and engineering application of earth science, spatial cognition, and smart city. Geospatial intelligence, as an inter-discipline between geospatial science and artificial intelligence, is driven by dual disciplines. At present, it has made important progress in hardware research, system development, data and model sharing, services and applications, and is also facing new challenges. This paper first describes the conceptual evolution of geospatial artificial intelligence and lists the frameworks of some technical systems. The paper then reviews the state-of-the-art in the scientific research and typical application domains. The problems and challenges facing geospatial intelligence are analyzed. Finally, some future prospects and trends are presented.

Key words: geospatial artificial intelligence, geospatial science, artificial intelligence, high-performance computing, deep learning

CLC Number:

P208

ZHANG Yongsheng, ZHANG Zhenchao, TONG Xiaochong, JI Song, YU Ying, LAI Guangling. Progress and challenges of geospatial artificial intelligence[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(9): 1137-1146.

References

[1] JANOWICZ K, GAO Song, MCKENZIE G, et al. GeoAI: spatially explicit artificial intelligence techniques for geographic knowledge discovery and beyond[J]. International Journal of Geographical Information Science, 2020, 34(4): 625-636.
[2] 周成虎. 全空间地理信息系统展望[J]. 地理科学进展, 2015, 34(2): 129-131. ZHOU Chenghu. Prospects on pan-spatial information system[J]. Progress in Geography, 2015, 34(2): 129-131.
[3] 熊伟. “智慧中国”下的测绘地理信息智能体系[J]. 测绘科学, 2014, 39(7): 21-24. XIONG Wei. Study on surveying and geoinformation intelligent system of smarter China[J]. Science of Surveying and Mapping, 2014, 39(7): 21-24.
[4] 汤竞煌, 方靖, 黄绘青. 地理空间信息智能分析研究[J]. 国土资源导刊, 2016, 13(2): 84-88. TANG Jinghuang, FANG Jing, HUANG Huiqing. Research on geospatial information intelligent analysis[J]. Land & Resources Herald, 2016, 13(2): 84-88.
[5] 赵亚非, 崔维康, 汪显如. 地理空间信息技术在智慧城市中的应用[J]. 华东科技(综合), 2018(8): 394-395. ZHAO Yafei, CUI Weikang,WANG Xianru. Applications of geospatial information in smart cities[J]. Science and Technology of East China, 2018(8): 394-395.
[6] 黄波, 吴波, 刘彪, 等. 空间智能: 地理信息科学的新进展[J].遥感学报, 2008,12(5): 766-771. HUANG Bo, WU Bo, LIU Biao, et al. Spatial intelligence: advancement of geographic information science[J]. Journal of Remote Sensing, 2008, 12(5): 766-771.
[7] 国家测绘地理信息局测绘发展研究中心. 蓝皮书: 2030建成智慧中国地理空间智能体系[R]. 北京:中国科技信息, 2014, 5: 1-10. Surveying and Mapping Development Research Center, State Bureau of Surveying, Mapping and Geographic Information. The blue book: to build the geospatial intelligence system for smarter China [R].Beijing:China Science and Technology Information, 2014, 5:1-10.
[8] HU Yingjie, GAO Song, NEWSAM S, et al. GeoAI 2018 workshop report the 2nd ACM SIGSPATIAL international workshop on GeoAI[J]. SIGSPATIAL Special, 2019, 10(3): 16.
[9] 高松. 地理空间人工智能的近期研究总结与思考[J]. 武汉大学学报(信息科学版), 2020, 45(12): 1865-1874. GAO Song. A review of recent researches and reflections on geospatial artificial intelligence[J]. Geomatics and Information Science of Wuhan University, 2020, 45(12): 1865-1874.
[10] Geospatial Commission of British. British geospatial commission [R].Banaba Island: Future Technologies Review. 2019: 1-20.
[11] 胡祎. 地理信息系统(GIS)发展史及前景展望[D]. 北京: 中国地质大学(北京), 2011. HU Yi. Introduction of geographic information system history and prospects[D]. Beijing: China University of Geosciences, 2011.
[12] GOODFELLOW I, BENGIO Y, COURVILLE A. Deep learning [M]. Cambridge: The MIT Press; 2016.
[13] 李德仁. 展望大数据时代的地球空间信息学[J]. 测绘学报, 2016, 45(4): 379-384.DOI:10.11947/j.AGCS.2016.20160057. LI Deren. Towards geo-spatial information science in big data era[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(4): 379-384.DOI:10.11947/j.AGCS.2016.20160057.
[14] 张永生. 现场直播式地理空间信息服务的构思与体系[J]. 测绘学报, 2011, 40(1): 1-4. ZHANG Yongsheng. The conception and architecture of live-service for geospatial information[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(1): 1-4.
[15] 龚健雅, 季顺平. 摄影测量与深度学习[J].测绘学报, 2018, 47(6): 693-704.DOI:10.11947/j.AGCS.2018.20170640. Gong Jianya, JI Shunping. Photogrammetry and deep learning[J]. Acta Geodaetica et Cartographica Sinica, 2018,47(6): 693-704.DOI:10.11947/j.AGCS.2018.20170640.
[16] LI Wenwen, HSU C Y. Automated terrain feature identification from remote sensing imagery: a deep learning approach[J]. International Journal of Geographical Information Science, 2020, 34(4): 637-660.
[17] XU Yongyang, XIE Zhong, FENG Yaxing, et al. Road extraction from high-resolution remote sensing imagery using deep learning[J]. Remote Sensing, 2018, 10(9): 1461.
[18] QIU Chunping, MOU Lichao, SCHMITT M, et al. Local climate zone-based urban land cover classification from multi-seasonal Sentinel-2 images with a recurrent residual network[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 154: 151-162.
[19] 李大军, 何维龙, 郭丙轩, 等. 基于Mask-RCNN的建筑物目标检测算法[J]. 测绘科学, 2019, 44(10): 172-180. LI Dajun, HE Weilong, GUO Bingxuan, et al. Building target detection algorithm based on Mask-RCNN[J]. Science of Surveying and Mapping, 2019, 44(10): 172-180.
[20] 余东行, 郭海涛, 张保明, 等. 级联卷积神经网络的遥感影像飞机目标检测[J]. 测绘学报, 2019, 48(8): 1046-1058.DOI: 10.11947/j.AGCS.2019.20180471. YU Donghang, GUO Haitao, ZHANG Baoming, et al. Aircraft detection in remote sensing images using cascade convolutional neural networks[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(8): 1046-1058.DOI: 10.11947/j.AGCS.2019.20180471.
[21] SU Hao, WEI Shunjun, LIU Shan, et al. HQ-ISNet: high-quality instance segmentation for remote sensing imagery[J]. Remote Sensing, 2020, 12(6): 989.
[22] KELLENBERGER B, MARCOS D, LOBRY S, et al. Half a percent of labels is enough: efficient animal detection in UAV imagery using deep CNNs and active learning[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(12): 9524-9533.
[23] ZHAN Yang, FU Kun, YAN Menglong, et al. Change detection based on deep Siamese convolutional network for optical aerial images[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(10): 1845-1849.
[24] LI Fashuai, LEHTOMÄKI M, OUDE ELBERINK S, et al. Semantic segmentation of road furniture in mobile laser scanning data[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 154: 98-113.
[25] LIN Yaping, VOSSELMAN G, CAO Yanpeng, et al. Active and incremental learning for semantic ALS point cloud segmentation[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 169: 73-92.
[26] ZHANG Zhenchao, VOSSELMAN G, GERKE M, et al. Detecting building changes between airborne laser scanning and photogrammetric data[J]. Remote Sensing, 2019, 11(20): 2417.
[27] LIU Luyang, JIA Zhenhong, YANG Jie, et al. SAR image change detection based on mathematical morphology and the K-means clustering algorithm[J]. IEEE Access, 2019, 7: 43970-43978.
[28] MULLISSA A G, PERSELLO C, STEIN A. PolSARNet: a deep fully convolutional network for polarimetric SAR image classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, 12(12): 5300-5309.
[29] YANG K, LIU Z, LU Q, et al. Multi-scale weighted branch network for remote sensing image classification[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Honolulu, Hawaii:IEEE,2019: 1-10.
[30] ZHANG Wenkai, HUANG Hai, SCHMITZ M, et al. Effective fusion of multi-modal remote sensing data in a fully convolutional network for semantic labeling[J]. Remote Sensing, 2017, 10(2): 52.
[31] FU G, LIU C, ZHOU R, et al. Classification for high resolution remote sensing imagery using a fully convolutional network[J]. Remote Sensing, 2017, 9(5): 498.
[32] MOU Lichao, SCHMITT M, WANG Yuanyuan, et al. A CNN for the identification of corresponding patches in SAR and optical imagery of urban scenes[C]//Proceedings of 2017 Joint Urban Remote Sensing Event (JURSE). Dubai, United Arab Emirates: IEEE, 2017: 1-4.
[33] 蓝朝桢, 卢万杰, 于君明, 等. 异源遥感影像特征匹配的深度学习算法[J]. 测绘学报, 2021, 50(2): 189-202. LAN Chaozhen, LU Wanjie, YU Junming, et al. Deep learning algorithm for feature matching of cross modality remote sensing images[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(2): 189-202.
[34] ZANJANI F G, VAN GERVEN M. Improving semantic video segmentation by dynamic scene integration[C]//Proceedings of 2016 Netherlands Conference on Computer Vision. Lunteren: The Netherlands: NCCV,2016.
[35] 邸凯昌. 空间数据发掘与知识发现[M]. 武汉:武汉大学出版社, 2000. DI Kaichang, Spatial data mining and knowledge discovery[M]. Wuhan: Wuhan University Press, 2000.
[36] SINGH A, SINGH R, BHATTACHARYA P. GIS based DSS model for business site selection[J]. Journal of Information Technology and Electrical Engineering, 2019, 8(4): 1-6.
[37] ZHANG Fan, WU Lun, ZHU Di, et al. Social sensing from street-level imagery: a case study in learning spatio-temporal urban mobility patterns[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 153: 48-58.
[38] HE Y, SHENG Y, JING Y, et al. Uncorrelated geo-text inhibition method based on Voronoi k-order and spatial correlations in web maps[J]. ISPRS International Journal of Geo-Information, 2020, 9(6): 381.
[39] ZHU Ruoxin, LIN Diao, JENDRYKE M, et al. Geo-tagged social media data-based analytical approach for perceiving impacts of social events[J]. ISPRS International Journal of Geo-Information, 2018, 8(1): 15.
[40] EBRAHIMPOUR Z, WAN Wanggen, VELÁZQUEZ GARCÍA J L, et al. Analyzing social-geographic human mobility patterns using large-scale social media data[J]. ISPRS International Journal of Geo-Information, 2020, 9(2): 125.
[41] LEVIN N, KARK S, CRANDALL D. Where have all the people gone? Enhancing global conservation using night lights and social media[J]. Ecological Applications, 2015, 25(8): 2153-2167.
[42] TAUBENBÖCK H, STAAB J, ZHU XIAOXIANG, et al. Are the poor digitally left behind? indications of urban divides based on remote sensing and twitter data[J]. International Journal of Geo-Information, 2018, 7(8): 304.
[43] VETRIVEL A, GERKE M, KERLE N, et al. Identification of structurally damaged areas in airborne oblique images using a visual-bag-of-words approach[J]. Remote Sensing, 2016, 8(3): 231.
[44] VETRIVEL A, GERKE M, KERLE N, et al. Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 140: 45-59.
[45] ESFANDIARI M, ABDI G, JABARI S, et al. Flood hazard risk mapping using a pseudo supervised random forest[J]. Remote Sensing, 2020, 12(19): 3206.
[46] GRAFF C A, COFFIELD S R, CHEN Yang, et al. Forecasting daily wildfire activity using Poisson regression[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 58(7): 4837-4851.
[47] SYIFA M, PANAHI M, LEE C W. Mapping of post-wildfire burned area using a hybrid algorithm and satellite data: the case of the camp fire wildfire in California, USA[J]. Remote Sensing, 2020, 12(4): 623.
[48] SAMEEN M I, PRADHAN B. Landslide detection using residual networks and the fusion of spectral and topographic information[J]. IEEE Access, 2019, 7: 114363-114373.
[49] HÄHNEL P, MAREČEK J, MONTEIL J, et al. Using deep learning to extend the range of air pollution monitoring and forecasting[J]. Journal of Computational Physics, 2020, 408: 109278.
[50] VAN ZOEST V, OSEI F B, HOEK G, et al. Spatio-temporal regression kriging for modelling urban NO2 concentrations[J]. International Journal of Geographical Information Science, 2020, 34(5): 851-865.
[51] MOHAJERANI Y, WOOD M, VELICOGNA I, et al. Detection of glacier calving margins with convolutional neural networks: a case study[J]. Remote Sensing, 2019, 11(1): 74.
[52] GUIRADO E, ALCARAZ-SEGURA D, CABELLO J, et al. Tree cover estimation in global dry lands from space using deep learning[J]. Remote Sensing, 2020, 12(3): 343.
[53] STUBBINGS P, PESKETT J, ROWE F, et al. A hierarchical urban forest index using street-level imagery and deep learning[J]. Remote Sensing, 2019, 11(12): 1395.
[54] SOUSA D, SMALL C. Mapping and monitoring rice agriculture with multisensor temporal mixture models[J]. Remote Sensing, 2019, 11(2): 181.
[55] SYLVAIN J D, DROLET G, BROWN N. Mapping dead forest cover using a deep convolutional neural network and digital aerial photography[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 156: 14-26.
[56] GUO Qinghua, SU Yanjun, HU Tianyu, et al.LiDAR boosts 3D ecological observations and modeling: a review and perspective[J]. IEEE Geoscience and Remote Sensing Magazine, 2021, 9(1): 232-257.
[57] KAMEL BOULOS M N, PENG Guochao, VOPHAM T. An overview of GeoAI applications in health and healthcare[J]. International Journal of Health Geographies, 2019, 18(1): 7.
[58] VOPHAM T, HART J E, LADEN F, et al. Emerging trends in geospatial artificial intelligence (GeoAI): potential applications for environmental epidemiology[J]. Environmental Health, 2018, 17(1): 1-6.
[59] FRANCH-PARDO I, NAPOLETANO B M, ROSETE-VERGES F, et al. Spatial analysis and GIS in the study of COVID-19: a review[J]. Science of The Total Environment, 2020, 739: 140033.
[60] 刘勇. 基于空间数据挖掘的热门景点及线路推荐研究[D]. 武汉:华中师范大学,2017. LIU Yong. Research on hot spots and tourist route recommendation based on spatial data mining[D]. Wuhan: Central China Normal University, 2017.
[61] NYIMBILI P H, ERDEN T. GIS-based fuzzy multi-criteria approach for optimal site selection of fire stations in Istanbul, Turkey[J]. Socio-Economic Planning Sciences, 2020, 71: 100860.
[62] ZHANG Jiaxing, XIAO Wen, COIFMAN B, et al. Vehicle tracking and speed estimation from roadside LiDAR[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 13: 5597-5608.
[63] LÜ Y, DUAN Yanjie, KANG Wenwen, et al. Traffic flow prediction with big data: a deep learning approach[J]. IEEE Transactions on Intelligent Transportation Systems, 2015, 16(2): 865-873.
[64] LU Weixin, ZHOU Yao, WAN Guowei, et al. L3-net: towards learning based LiDAR localization for autonomous driving[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach, CA, USA:IEEE, 2019: 6382-6391.
[65] FEI Xiaohan, WONG A, SOATTO S. Geo-supervised visual depth prediction[J]. IEEE Robotics and Automation Letters, 2019, 4(2): 1661-1668.
[66] CUI Yang, LI Qingquan, YANG Bisheng, et al. Automatic 3D reconstruction of indoor environment with mobile laser scanning point clouds[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, 12(8): 3117-3130.
[67] 窦笑. 基于深度学习的机器人环境感知研究[D]. 哈尔滨:哈尔滨工程大学,2019. DOU Xiao. Research on robot environment perception based on deep learning[D]. Harbin: Harbin Engineering University, 2019.
[68] 敖焕轩. 基于深度学习与单目视觉SLAM的三维语义场景建模研究[D]. 南京:东南大学,2018. AO Huanxuan. 3D semantic mapping based on deep learning and monocular visual SLAM[D]. Nanjing: Southeast University, 2018.
[69] 张永生, 于英, 薛武. 无人机地理影像直播技术[M]. 北京:科学出版社, 2020. ZHANG Yongsheng, YU Ying, XUE Wu. UAV geographic image live broadcast technology[M]. Beijing: Science Press, 2020.
[70] 霍华德·加德纳[美]. 智能的结构[M]. 沈致隆,译. 北京: 中国人民大学出版社, 2008. Gardner Howard. Frames of mind[M].SHEN Zhilong, trans.Beijing: China Renmin University Press, 2008.
[71] 朱建章,石强,陈凤娥,等. 遥感大数据研究现状与发展趋势[J]. 中国图象图形学报, 2016, 21(11):1425-1439. ZHU Jianzhang, SHI Qiang, CHEN Fenge, et al. Research status and development trends of remote sensing big data[J]. Journal of Image and Graphics, 2016, 21(11):1425-1439.
[72] DONG Zhen, LIANG Fuxun, YANG Bisheng, et al. Registration of large-scale terrestrial laser scanner point clouds: a review and benchmark[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 163: 327-342.
[73] 张继贤, 林祥国, 梁欣廉. 点云信息提取研究进展和展望[J]. 测绘学报, 2017, 46(10): 1460-1469. ZHANG Jixian, LIN Xiangguo, LIANG Xinlian. Advances and prospects of information extraction from point clouds[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10): 1460-1469.
[74] 张永军, 张祖勋, 龚健雅. 天空地多源遥感数据的广义摄影测量学[J]. 测绘学报, 2021, 50(1): 1-11. ZHANG Yongjun, ZHANG Zuxun, GONG Jianya. Generalized photogrammetry of spaceborne, airborne and terrestrial multi-source remote sensing datasets[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(1): 1-11.