Recent progress in large-scale 3D city modeling

doi:10.11947/j.AGCS.2019.20190471

Abstract

Abstract: Large scale 3D city models become increasingly demanding for urban planning and management, environmental simulation, emergency response, navigation, virtual tourism and other scientific and public applications. Considerable achievements have been accomplished over the past two decades through joint efforts from multiple disciplines. The objective of this paper is to comprehensively summarize and discuss the current technologies and recent progresses of 3D city modeling in data sources, modeling methods and platforms, 3D city model representation and interoperability. Finally, several representative examples of open city models across the world are described. Driven by the increasing diverse data, advanced yet affordable technology, and growing public and scientific needs, 3D city modeling is accelerating to be automatic, meticulous, semantic, standardized, seamless, and open to the general public.

Key words: 3D city models, model representation, CityGML, level of detail, open data

CLC Number:

P237

SHAN Jie, LI Zhixin, ZHANG Wenyuan. Recent progress in large-scale 3D city modeling[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(12): 1523-1541.

References

[1] BILLEN R, MÉTRAL C, FALQUET G, et al. Challenges of semantic 3D city models:a contribution of the COST Research Action TU0801[J]. International Journal of 3-D Information Modeling, 2015, 4(2):68-76.
[2] BILLEN R, CUTTING-DECELLE A F, MARINA O, et al. 3D city models and urban information:current issues and perspectives[M]. Cedex (France):EDP Sciences, 2014.
[3] MCFADDEN C. 19 of the biggest city models in the world[EB/OL]. (2018)[2019-10-29]. https://interestingengineering.com/19-of-the-biggest-city-models-in-the-world.
[4] HEO J, JEONG S, PARK H K, et al. Productive high-complexity 3D city modeling with point clouds collected from terrestrial LiDAR[J]. Computers, Environment and Urban Systems, 2013, 41:26-38.
[5] DÖLLNER J, BAUMANN K, BUCHHOLZ H. Virtual 3D city models as foundation of complex urban information spaces[C]//Proceedings of CORP 2006 and Geomultimedia. Vienna, Austria:[s.n.], 2006:107-112.
[6] JULIN A, JAALAMA K, VIRTANEN J P, et al. Characterizing 3d city modeling projects:towards a harmonized interoperable system[J]. ISPRS International Journal of Geo-Information, 2018, 7(2):55.
[7] BILJECKI F, STOTER J, LEDOUX H, et al. Applications of 3D city models:state of the art review[J]. ISPRS International Journal of Geo-Information, 2015, 4(4):2842-2889.
[8] QUATTRINI R, PIERDICCA R, MORBIDONI C. Knowledge-based data enrichment for HBIM:exploring high-quality models using the semantic-web[J]. Journal of cultural heritage, 2017, 28:129-139.
[9] Planet. Daily satellite imagery and insights[EB/OL]. (2019)[2019-11-05]. https://www.planet.com/.
[10] 李德仁, 刘立坤, 邵振峰. 集成倾斜航空摄影测量和地面移动测量技术的城市环境监测[J]. 武汉大学学报(信息科学版), 2015, 40(4):427-435, 443. LI Deren, LIU Likun, SHAO Zhenfeng. An integration of aerial oblique photogrammetry and mobile mapping system for urban geographical conditions monitoring[J]. Geomatics and Information Science of Wuhan University, 2015, 40(4):427-435, 443.
[11] ZHANG Liqiang, LI Zhuqiang, LI Anjian, et al. Large-scale urban point cloud labeling and reconstruction[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 138:86-100.
[12] TOMLJENOVIC I, HÖFLE B, TIEDE D, et al. Building extraction from airborne laser scanning data:an analysis of the state of the art[J]. Remote Sensing, 2015, 7(4):3826-3862.
[13] STOKER J M, ABDULLAH Q A, NAYEGANDHI A, et al. Evaluation of single photon and Geiger mode LiDAR for the 3D elevation program[J]. Remote Sensing, 2016, 8(9):767.
[14] WANG Yanjun, CHEN Qi, ZHU Qing, et al. A survey of mobile laser scanning applications and key techniques over urban areas[J]. Remote Sensing, 2019, 11(13):1540.
[15] LIANG Xinlian, KUKKO A, KAARTINEN H, et al. Possibilities of a personal laser scanning system for forest mapping and ecosystem services[J]. Sensors, 2014, 14(1):1228-1248.
[16] NOCERINO E, MENNA F, REMONDINO F, et al. Investigation of indoor and outdoor performance of two portable mobile mapping systems[C]//Proceedings of the SPIE 10332, Videometrics, Range Imaging, and Applications XIV. Munich, Germany:SPIE, 2017:103320I.
[17] GOODCHILD M F. Citizens as sensors:the world of volunteered geography[J]. GeoJournal, 2007, 69(4):211-221.
[18] OVER M, SCHILLING A, NEUBAUER S, et al. Generating web-based 3D city models from OpenStreetMap:the current situation in Germany[J]. Computers, Environment and Urban Systems, 2010, 34(6):496-507.
[19] GOETZ M. Towards generating highly detailed 3D CityGML models from OpenStreetMap[J]. International Journal of Geographical Information Science, 2013, 27(5):845-865.
[20] HADIMLIOGLU I A, KING S A. City maker:reconstruction of cities from OpenStreetMap data for environmental visualization and simulations[J]. ISPRS International Journal of Geo-Information, 2019, 8(7):298.
[21] 单杰. 从专业遥感到大众遥感[J]. 测绘学报, 2017, 46(10):1434-1446. DOI:10.11947/j.AGCS.2017.20170361. SHAN Jie. Remote sensing:from trained professionals to general public[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10):1434-1446. DOI:10.11947/j.AGCS.2017.20170361.
[22] SIMO-SERRA E, TRULLS E, FERRAZ L, et al. Discriminative learning of deep convolutional feature point descriptors[C]//Proceedings of the IEEE International Conference on Computer Vision. Santiago, Chile:IEEE, 2015:118-126.
[23] YI K M, TRULLS E, LEPETIT V, et al. LIFT:learned invariant feature transform[C]//Proceedings of the 14th European Conference on Computer Vision. Amsterdam, The Netherlands:Springer, 2016:467-483.
[24] MELEKHOV I, TIULPIN A, SATTLER T, et al. DGC-Net:dense geometric correspondence network[C]//Proceedings of 2019 IEEE Winter Conference on Applications of Computer Vision. Waikoloa Village:IEEE, 2019:1034-1042.
[25] 单杰. 光束法平差简史与概要[J]. 武汉大学学报(信息科学版), 2018, 43(12):1797-1810. SHAN Jie. A brief history and essentials of bundle adjustment[J]. Geomatics and Information Science of Wuhan University, 2018, 43(12):1797-1810.
[26] 杜建丽, 陈动, 张振鑫, 等. 建筑点云几何模型重建方法研究进展[J]. 遥感学报, 2019, 23(3):374-391. DU Jianli, CHEN Dong, ZHANG Zhenxin, et al. Research progress of building reconstruction via airborne point clouds[J]. Journal of Remote Sensing, 2019, 23(3):374-391.
[27] AMENTA N, BERN M, KAMVYSSELIS M. A New Voronoi-based surface reconstruction algorithm[C]//Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. Orlando, FL:ACM, 1998:415-421.
[28] KAZHDAN M, HOPPE H. Screened Poisson surface reconstruction[J]. ACM Transactions on Graphics, 2013, 32(3):Article No.29.
[29] XU Bo, JIANG Wanshou, SHAN Jie, et al. Investigation on the Weighted RANSAC approaches for building roof plane segmentation from LiDAR point clouds[J]. Remote Sensing, 2016, 8(1):5.
[30] QI CHARLES R, SU Hao, KAICHUN M, et al. Pointnet:deep learning on point sets for 3d classification and segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, Hawaii:IEEE, 2017:77-85.
[31] WANG Ruisheng, PEETHAMBARAN J, CHEN Dong. LiDAR point clouds to 3D urban models:a review[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, 11(2):606-627.
[32] ZENG Huayi, WU Jiaye, FURUKAWA Y. Neural procedural reconstruction for residential buildings[C]//Proceedings of the 15th European Conference on Computer Vision. Munich, Germany:Springer, 2018:759-775.
[33] LEOTTA M J, LONG Chengjiang, JACQUET B, et al. Urban semantic 3D reconstruction from Multiview satellite imagery[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. Long Beach, CA:IEEE, 2019:1-10.
[34] YANG B, LEE J. Improving accuracy of automated 3D building models for smart cities[J]. International Journal of Digital Earth, 2019, 12(2):209-227.
[35] 张春森, 张卫龙, 郭丙轩, 等. 倾斜影像的三维纹理快速重建[J]. 测绘学报, 2015, 44(7):782-790. DOI:10.11947/j.AGCS.2015.20140341. ZHANG Chunsen, ZHANG Weilong, GUO Bingxuan, et al. Rapidly 3D texture reconstruction based on oblique photography[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(7):782-790. DOI:10.11947/j.AGCS.2015.20140341.
[36] LEE J, YANG B. Developing an optimized texture mapping for photorealistic 3D buildings[J]. Transactions in GIS, 2019, 23(1):1-21.
[37] 李德仁. 论地球空间信息的3维可视化:基于图形还是基于影像[J]. 测绘学报, 2010, 39(2):111-114. LI Deren. 3D visualization of geospatial information:graphics based or imagery based[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(2):111-114.
[38] ABAYOWA B O, YILMAZ A, HARDIE R C. Automatic registration of optical aerial imagery to a LiDAR point cloud for generation of city models[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015, 106:68-81.
[39] WEN Xuedong, XIE Hong, LIU Hua, et al. Accurate reconstruction of the LoD3 building model by integrating multi-source point clouds and oblique remote sensing imagery[J]. ISPRS International Journal of Geo-Information, 2019, 8(3):135.
[40] WU Bo, XIE Linfu, HU Han, et al. Integration of aerial oblique imagery and terrestrial imagery for optimized 3D modeling in urban areas[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 139:119-132.
[41] PARISH Y I H, MVLLER P. Procedural modeling of cities[C]//Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. Los Angeles:ACM, 2001:301-308.
[42] KOLBE T H. BIM, CityGML, and related standardization[C]//Proceedings of 2012 Digital Landscape Architecture Conference, Bernburg/Dessau, Germany. 2012, 31.
[43] CONSORTIUM W, OTHERS. X 3d international specification standards[R].[S.L]:Web 3D Consortium, 2005.
[44] WILSON T. OGC®KML. Version 2.2. 0[R].[S.L]:Open Geospatial Consortium, 2008.
[45] ARNAUD R, BARNES M C. COLLADA:sailing the gulf of 3D digital content creation[M].[S.L]:AK Peters/CRC Press, 2006.
[46] GRÖGER G, KOLBE T H, NAGEL C, et al. OGC City Geography Markup Language (CityGML) encoding standard, version 2.0.0[R].[S.l.]:Open Geospatial Consortium, 2012.
[47] Open Geospatial Consortium. OGCIndoorGML[S]. OGC 14-005r3, 2014.
[48] LAAKSO M, KIVINIEMI A O. The IFC standard:a review of history, development, and standardization, information technology[J]. ITcon, 2012, 17(9):134-161.
[49] GRÖGER G, PLVMER L. CityGML-interoperable semantic 3D city models[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2012, 71:12-33.
[50] VAN DEN BRINK L, STOTER J, ZLATANOVA S. UML-based approach to developing a CityGML application domain extension[J]. Transactions in GIS, 2013, 17(6):920-942.
[51] LI Lin, LUO Feng, ZHU Haihong, et al. A two-level topological model for 3D features in CityGML[J]. Computers, Environment and Urban Systems, 2016, 59:11-24.
[52] KOLBE T H, BURGER B, CANTZLER B. CityGML goes to broadway[C]//Proceedings of the 55th Photogrammetric Week. Stuttgart, Germany:[s.n.], 2015:343-356.
[53] DENG Yichuan, CHENG J C P, ANUMBA C. Mapping between BIM and 3D GIS in different levels of detail using schema mediation and instance comparison[J]. Automation in Construction, 2016, 67:1-21.
[54] KOLBE T H. Representing and exchanging 3D city models with CityGML[C]//Proceedings of the 3rd International Workshop on 3D Geo-Information. Seoul, Korea:Springer, 2009:15-31.
[55] BILJECKI F, LEDOUX H, STOTER J. An improved LOD specification for 3D building models[J]. Computers, Environment and Urban Systems, 2016, 59:25-37.
[56] VAN DEN BRINK L, STOTER J, ZLATANOVA S. Establishing a national standard for 3D topographic data compliant to CityGML[J]. International Journal of Geographical Information Science, 2013, 27(1):92-113.
[57] BILJECKI F, LEDOUX H, STOTER J, et al. The variants of an LOD of a 3D building model and their influence on spatial analyses[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2016, 116:42-54.
[58] KADEN R, KOLBE T. City-Wide total energy demand estimation of buildings using semantic 3D city models and statistical data[C]//Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Istanbul, Turkey, 2013:27-29.
[59] KRVGER A, KOLBE T H. Building analysis for urban energy planning using key indicators on virtual 3D city models:the energy atlas Of Berlin[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Melbourne, Australia, 2012:145-150.
[60] AGUGIARO G, BENNER J, CIPRIANO P. The energy application domain extension for CityGML:enhancing interoperability for urban energy simulations[J]. Open Geospatial Data, Software and Standards, 2018, 3(2):1-30.
[61] ISIKDAG U, ZLATANOVA S, UNDERWOOD J. A BIM-oriented model for supporting indoor navigation requirements[J]. Computers, environment and urban systems, 2013, 41:112-123.
[62] CHEN L C, WU C H, SHEN T S, et al. The application of geometric network models and building information models in geospatial environments for fire-fighting simulations[J]. Computers, Environment and Urban Systems, 2014, 45:1-12.
[63] AMIREBRAHIMI S, RAJABIFARD A, MENDIS P, et al. A framework for a microscale flood damage assessment and visualization for a building using BIM-GIS integration[J]. International Journal of Digital Earth, 2016, 9(4):363-386.
[64] BILJECKI F, LEDOUX H, STOTER J, et al. The variants of an LOD of a 3D building model and their influence on spatial analyses[J]. ISPRS journal of photogrammetry and remote sensing, 2016, 116:42-54.
[65] BOETERS R, OHORI K A, BILJECKI F, et al. Automatically enhancing CityGML LOD2 models with a corresponding indoor geometry[J]. International Journal of Geographical Information Science, 2015, 29(12):2248-2268.
[66] GARLAND M, HECKBERT P S. Surface simplification using quadric error metrics[C]//Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. Los Angeles, CA:ACM, 1997:209-216.
[67] COHEN-STEINER D, ALLIEZ P, DESBRUN M. Variational shape approximation[C]//Proceedings of SIGGRAPH'04 ACM SIGGRAPH. Los Angeles, NY:ACM, 2004:905-914.
[68] THIEMANN F, SESTER M. Segmentation of buildings for 3D-generalisation[C]//Proceedings of the ICA Workshop on generalization and multiple representation. Leicester, UK:[s.n.], 2004:2021.
[69] FAN Hongchao, MENG Liqiu, JAHNKE M. Generalization of 3D buildings modelled by CityGML[M]//SESTER M, BERNARD L, PAELKE V. Advances in GIScience. Berlin Heidelberg:Springer, 2009:387-405.
[70] YAO Zhihang, NAGEL C, KUNDE F, et al. 3DCityDB-a 3D geodatabase solution for the management, analysis, and visualization of semantic 3D city models based on CityGML[J]. Open Geospatial Data, Software and Standards, 2018, 3(1):5.
[71] WANG Hao, PAN Yisha, LUO Xiaochun. Integration of BIM and GIS in sustainable built environment:a review and Bibliometric analysis[J]. Automation in Construction, 2019, 103:41-52.
[72] EL-MEKAWY M, ÖSTMAN A. Semantic mapping:an ontology engineering method for integrating building models in IFC and CITYGML[C]//Proceedings of the 3rd ISDE Digital Earth Summit. Nessebar, Bulgaria:[s.n.], 2010:1-11.
[73] EL-MEKAWY M, ÖSTMAN A, HIJAZI I. A unified building model for 3D urban GIS[J]. ISPRS International Journal of Geo-Information, 2012, 1(2):120-145.
[74] DONKERS S, LEDOUX H, ZHAO Junqiao, et al. Automatic conversion of IFC datasets to geometrically and semantically correct CityGML LOD3 buildings[J]. Transactions in GIS, 2016, 20(4):547-569.
[75] VAN BERLO L, LAAT R D. Integration of BIM and GIS:The development of the CityGMLGeoBIM extension[J]. Advances in 3D Geo-Information Sciences, 2011:211-225.
[76] XU Xun, DING Lieyun, LUO Hanbin, et al. From building information modeling to city information modeling[J]. Journal of Information Technology in Construction, 2014, 19:292-307.
[77] STOUFFS R, TAUSCHER H, BILJECKI F. Achieving complete and near-lossless conversion from IFC to CityGML[J]. ISPRS International Journal of Geo-Information, 2018, 7(9):355.
[78] JUSUF S K, MOUSSEAU B, GODFROID G, et al. Path to an integrated modelling between IFC and CityGML for neighborhood scale modelling[J]. Urban Science, 2017, 1(3):25.
[79] 3D geoinformation. Cities/regions around the world with open datasets[EB/OL].[2019-10-30]. https://3d.bk.tudelft.nl/opendata/.
[80] DÖLLNER J, KOLBE T H, LIECKE F, et al. The virtual 3D city model of berlin-managing, integrating, and communicating complex urban information[C]//Proceedings of the 25th International Symposium on Urban Data Management. Aalborg, Denmark:[s.n.], 2006:1-13.
[81] 李德仁. 展望大数据时代的地球空间信息学[J]. 测绘学报, 2016, 45(4):379-384. DOI:10.11947/j.AGCS.2016.20160057. LI Deren. Towards geo-spatial information science in big data era[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(4):379-384. DOI:10.11947/j.AGCS.2016.20160057.