Rapidly 3D Texture Reconstruction Based on Oblique Photography

doi:10.11947/j.AGCS.2015.20140341

Abstract

Abstract:

This paper proposes a city texture fast reconstruction method based on aerial tilt image for reconstruction of three-dimensional city model. Based on the photogrammetry and computer vision theory and using the city building digital surface model obtained by prior treatment, through collinear equation calculation geometric projection of object and image space, to obtain the three-dimensional information and texture information of the structure and through certain the optimal algorithm selecting the optimal texture on the surface of the object, realize automatic extraction of the building side texture and occlusion handling of the dense building texture. The real image texture reconstruction results show that: the method to the 3D city model texture reconstruction has the characteristics of high degree of automation, vivid effect and low cost and provides a means of effective implementation for rapid and widespread real texture rapid reconstruction of city 3D model.

Key words: 3D city model, texture reconstruction, oblique image, occlusion handling

CLC Number:

P234

ZHANG Chunsen, ZHANG Weilong, GUO Bingxuan, LIU Jianchen, LI Ming. Rapidly 3D Texture Reconstruction Based on Oblique Photography[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(7): 782-790.

References

[1] WANG Yanmin, HU Chunmei. A Robust Registration Method for Terrestrial LiDAR Point Clouds and Texture Image[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(2): 266-272. (王晏民, 胡春梅. 一种地面激光雷达点云与纹理影像稳健配准方法[J]. 测绘学报, 2012, 41(2): 266-272.)
[2] WU Jun. Research on Rapidly Reconstructing Texture for Facades in 3D City Modeling[J]. Acta Geodaetica et Cartographica Sinica, 2005, 34(4): 317-322. (吴军. 3维城市建模中的建筑墙面纹理快速重建研究[J]. 测绘学报, 2005, 34(4): 317-322.)
[3] WU Jun. Research on Rapidly Reconstructing Texture for Facades in 3D City Modeling[D]. Wuhan: Wuhan University, 2003. (吴军. 三维城市建模中的建筑墙面纹理快速重建研究[D]. 武汉: 武汉大学, 2003.)
[4] LI Hui. Road Extraction and Modeling with LiDAR and RS Image in Urban Area[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(1): 133. (李卉. 集成LiDAR和遥感影像城市道路提取与三维建模[J]. 测绘学报, 2011, 40(1): 133.)
[5] FRUEH C, JAIN S, ZAKHOR A. Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images[J]. International Journal of Computer Vision, 2005, 61(2): 159-184.
[6] FRUEH C, SAMMON R, ZAKHOR A. Automated Texture Mapping of 3D City Models with Oblique Aerial Imagery[C]//Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization, and Transmission. Thessaloniki, Greece: IEEE, 2004: 396- 403.
[7] CUI Hongxia, LIN Zongjian, Sun Jie. Research on the 3-dimensional Modeling Method for Remote Sensing Images of Big Degree of Overlap Acquired by Unmaned Aerial Vehicle[J]. Science of Surveying and Mapping, 2005, 30(2): 36-38. (崔红霞, 林宗坚, 孙杰. 大重叠度无人机遥感影像的三维建模方法研究[J]. 测绘科学, 2005, 30(2): 36-38.)
[8] WANG Qingdong, AI Haibin, ZHANG Li. Rapid City Modeling Based on Oblique Photography and 3Ds Max Technique[J]. Science of Surveying and Mapping, 2013, 39(6): 10-12. (王庆栋, 艾海滨, 张力. 利用倾斜摄影和3ds Max技术快速实现城市建模[J]. 测绘科学, 2013, 39(6): 10-12.)
[9] ZHANG Zuxun, WU Jun, ZHANG Jianqing. A Method for Determining Orientation Parameters in Image Based Reconstruction of Architectural Scene[J]. Geomatics and Informational Science of Wuhan University, 2003, 28(3): 265-271. (张祖勋, 吴军, 张剑清. 建筑场景三维重建中影像方位元素的获取方法[J]. 武汉大学学报: 信息科学版, 2003, 28(3): 265-271.)
[10] HUO Chunling, LIU Da. Study on Methods of Urban 3D Modeling Data Acquisition[J]. Journal of Heilongjiang Institute of Technology, 2007, 21(4): 21-23. (霍春玲, 刘达. 城市三维建模数据采集方法的研究[J]. 黑龙江工程学院学报, 2007, 21(4): 21-23.)
[11] ZHANG Jianqing, PAN Li, WANG Shugen. Photogrammetry[M]. Wuhan: Press of Wuhan University, 2003. (张剑清, 潘励, 王树根. 摄影测量学[M]. 武汉: 武汉大学出版社, 2003.)
[12] GUI Dezhu, LIN Zongjian, ZHANG Chengcheng. Research on Construction of 3D Building Based on Oblique Images from UAV[J]. Science of Surveying and Mapping, 2013, 37(4): 140-142. (桂德竹, 林宗坚, 张成成. 倾斜航空影像的城市建筑物三维模型构建研究[J]. 测绘科学, 2013, 37(4): 140-142.)
[13] YANG Ling, ZHANG Jianqing. Model-based Semi-automated Building Reconstruction from Aerial Images[J]. Computer Engineering and Applications, 2008, 44(33): 10-12. (杨玲, 张剑清. 基于模型的航空影像矩形建筑物半自动建模[J]. 计算机工程与应用, 2008, 44(33): 10-12.)
[14] JIANG Wanshou. Multiple Aerial Image Matching and Automatic Building Detection[D]. Wuhan: Wuhan University, 2004. (江万寿. 航空影像多视匹配与规则建筑物自动提取方法研究[D]. 武汉: 武汉大学, 2004.)
[15] GAO Rui, LIU Xiuguo, XIONG Wei. Research and Application of 3D Visualization of City[J]. Application Research of Computers, 2005, 22(3): 160-163. (高睿, 刘修国, 熊威. 城市三维景观可视化研究与应用[J]. 计算机应用研究, 2005, 22(3): 160-163.)
[16] HUANG Lei. Research on 3D Reconstruction of Virtual City Based on Image Sequence[D]. Qingdao: Ocean University of China, 2008. (黄磊. 基于图像序列的三维虚拟城市重建关键技术研究[D]. 青岛: 中国海洋大学, 2008.)
[17] XIE Yaohua. A Research on the Key Technology of Digital Photogrammetry and 3D Reconstruction System[D]. Changsha: National University of Defense Technology, 2004. (谢耀华. 数字摄影测量与三维重建系统关键技术研究[D]. 长沙: 国防科学技术大学, 2004.)
[18] WANG Yanxia. Research on Profile Extraction and Key Technologies for 3D Reconstruction[D]. Chongqing: Chongqing University, 2010. (王艳霞. 图像轮廓提取与三维重建关键技术研究[D]. 重庆: 重庆大学, 2010.)
[19] PENG Keju. 3D Reconstruction Using Image Sequences[D]. Changsha: National University of Defense Technology, 2012. (彭科举. 基于序列图像的三维重建算法研究[D]. 长沙: 国防科学技术大学, 2012.)
[20] HE Yuhang, YUE Jun. Research and Implementation Based on Multi-view Dense Matching by Applying CMVS/PMVS[J]. Journal of Geomatics, 2013, 38(4): 20-23. (何豫航, 岳俊. 基于CMVS/PMVS多视角密集匹配方法的研究与实现[J]. 测绘地理信息, 2013, 38(4): 20-23.)
[21] HARTLEY R, ZISSERMAN A. Multiple View Geometry in Computer Vision[M]. 2nd ed. London: Cambridge University Press, 2003.
[22] ZHOU Yang, ZHENG Shunyi, HUANG Rongyong, et al. Face-wise Poisson Blending with Color Transfer in Seamless Texturing[J]. Journal of Image and Graphics, 2014, 19(4): 512-519. (周漾, 郑顺义, 黄荣永, 等. 面泊松融合结合色彩变换的无缝纹理辐射处理[J]. 中国图象图形学报, 2014, 19(4): 512-519.)
[23] HU Qingwu, LI Qingquan. Image Restoration Based on Mask Technique[J]. Geomatics and Informational Science of Wuhan University, 2004, 29(4): 319-324. (胡庆武, 李清泉. 基于Mask原理的遥感影像恢复技术研究[J]. 武汉大学学报: 信息科学版, 2004, 29(4): 319-324.)
[24] HANUSCH T. Texture Mapping and True Orthophoto Generation of 3D Objects[M]. Zürich: Eth Zürich.
[25] WANG Bangsong, AI Haibin, AN Hong, et al. Research on Color Consistency Processing of Aerial Images[J]. Remote Sensing Information, 2011(1): 45-49. (王邦松, 艾海滨, 安宏, 等. 航空影像色彩一致性处理算法研究[J]. 遥感信息, 2011(1): 45-49.)
[26] ZHU Qiaoyun, DA Xing. Dodging Method for Multi-source Remote Sensing Images Based on Wallis Filter[J]. Geomatics & Spatial Information Technology, 2012, 35(10): 130-132. (朱巧云, 答星. 基于 Wallis 滤波器的异源遥感影像匀光方法[J]. 测绘与空间地理信息, 2012, 35(10): 130-132.)
[27] PHAM B, PRINGLE G. Color Correction for an Image Sequence[J]. IEEE Transactions on Computer Graphics and Applications, 1995, 15(3): 38-42.
[28] BORNIK A, KARNER K, BAUER J, et al. High Quality Texture Reconstruction from Multiple Views[J]. The Visual Computer, 2002, 13: 1-14.