带线约束的摄影测量网格变分精化算法

doi:10.11947/j.AGCS.2020.20190255

测绘学报 ›› 2020, Vol. 49 ›› Issue (4): 469-479.doi: 10.11947/j.AGCS.2020.20190255

带线约束的摄影测量网格变分精化算法

邓非^1,2, 陈欣¹, 颜青松¹, 曲英杰¹

1. 武汉大学测绘学院, 湖北武汉 430079;
2. 国土资源部城市土地资源监测与仿真重点实验室, 广东深圳 518000

收稿日期:2019-06-20 修回日期:2019-10-18 发布日期:2020-04-17
通讯作者: 陈欣 E-mail:xchen_whu@whu.edu.cn
作者简介:邓非(1976-),男,博士,教授,研究方向为摄影测量与计算机视觉。E-mail:fdeng@sgg.whu.edu.cn
基金资助:
国土资源部城市土地资源监测与仿真重点实验室开放基金（KF2018-03-025）

Variational refinement of mesh with line constraint for photogrammetry

DENG Fei^1,2, CHEN Xin¹, YAN Qingsong¹, QU Yingjie¹

1. School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China;
2. Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Land and Resources, Shenzhen 518000, China

Received:2019-06-20 Revised:2019-10-18 Published:2020-04-17
Supported by:
The Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Land and Resources (No. KF-2018-03-025)

摘要/Abstract

摘要： 针对城市场景三维重建模型在有线特征的边缘区域过于平滑的问题，提出一种带线约束的摄影测量网格变分精化方法。算法以初始重建网格模型为基础，引入3个能量项，将网格精化问题转化成能量下降问题。首先结合所有的影像信息构建影像一致性约束项，然后对网格表面顶点附加正则化约束，最后引入三维线特征约束，将3个能量项加权相加后离散化到每个顶点，得到梯度变化值。采用梯度下降法，使顶点沿着梯度方向移动，当能量不再下降或迭代一定次数时，即得到了精化后的网格模型。试验结果表明，本文算法能较好地保持边缘特征，与现有的泊松重建算法相比，网格的质量更高，视觉效果更好。

关键词: 三维重建, 影像一致性, 正则化, 线约束, 变分精化

Abstract: In order to solve the problem of that urban 3D reconstruction is too smooth in the edge area with line features, it is proposed a variational refinement of mesh with line constraint. The algorithm takes the initial reconstruction mesh as input and introduces three energy terms. Transforming the refinement problem into energy reduction problem. Firstly, photo-consistency constraints are constructed by combining all image information, and then regularization constraints are added to all the vertices of the mesh. Finally, 3D line constraint is added to energy term. The gradient difference value is obtained by discretizing sum of three weighted energy term to each vertex. Using gradient descent method to make each vertex move along the gradient vector. When the energy no longer decreases or reaches enough iterations, the refined mesh model is obtained. Calculating the coordinate corrections of each vertex by variational refinement iteration method. Thus, vertices naturally migrate to the object edges if any. The results show that the proposed algorithm can preserve the edge features better. Compared with the existing Poisson surface reconstruction algorithm, the quality of mesh is higher and the visual effect is better.

Key words: 3D reconstruction, photo consistency, regularization, line constraint, variational refinement

中图分类号:

P237

邓非, 陈欣, 颜青松, 曲英杰. 带线约束的摄影测量网格变分精化算法[J]. 测绘学报, 2020, 49(4): 469-479.

DENG Fei, CHEN Xin, YAN Qingsong, QU Yingjie. Variational refinement of mesh with line constraint for photogrammetry[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(4): 469-479.

参考文献

[1] MOULON P, MONASSE P, MARLET R. Adaptive structure from motion with a contrario model estimation[C]//Proceedings of the 11th Asian Conference of Computer Vision.Daejeon:Springer, 2012:257-270.
[2] WAECHTER M, MOEHRLE N, GOESELE M. Let there be color! large-scale texturing of 3D reconstructions[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland:Springer, 2014:836-850.
[3] 欧阳欢, 范大昭, 纪松, 等. 结合离散化描述与同名点约束的线特征匹配[J]. 测绘学报, 2018, 47(10):1363-1371. DOI:10.11947/j.AGCS.2018.20170231. OUYANG Huan, FAN Dazhao, JI Song, et al. Line matching based on discrete description and conjugate point constraint[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(10):1363-1371. DOI:10.11947/j.AGCS.2018.20170231.
[4] 李明, 张卫龙, 范丁元. 城市三维重建中的自动纹理优化方法[J]. 测绘学报, 2017, 46(3):338-345.DOI:10.11947/j.AGCS.2017.20160467. LI Ming, ZHANG Weilong, FAN Dingyuan. Automatic texture optimization for 3D urban reconstruction[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(3):338-345. DOI:10.11947/j.AGCS.2017.20160467.
[5] 姜翰青, 王博胜, 章国锋, 等. 面向复杂三维场景的高质量纹理映射[J]. 计算机学报, 2015, 38(12):2349-2360. JIANG Hanqing, WANG Bosheng, ZHANG Guofeng et al. High-quality texture mapping for complex 3D scenes[J]. Chinese Journal of Computers, 2015, 38(12):2349-2360.
[6] KAZHDAN M, BOLITHO M, HOPPE H. Poisson surface reconstruction[C]//Proceedings of the 4th Eurographics Symposium on Geometry Processing.Aire-la-Ville:ACM, 2006:61-70.
[7] KAZHDAN M, HOPPE H. Screened Poisson surface reconstruction[J]. ACM Transactions on Graphics, 2013, 32(3):61-70.
[8] GUARDA A F R, BIOUCAS-DIAS J M, RODRIGUES N M M, et al. Improving point cloud to surface reconstruction with generalized Tikhonov regularization[C]//Proceedings of the 19th International Workshop on Multimedia Signal Processing. Luton:IEEE, 2017:1-6.
[9] ESTELLERS V, SCOTT M, TEW K, et al. Robust Poisson surface reconstruction[C]//Proceedings of the 5th International Conference on Scale Space and Variational Methods in Computer Vision.Lège-Cap Ferret, France:Springer, 2015:525-537.
[10] DELAUNOY A, PRADOS E. Gradient flows for optimizing triangular mesh-based surfaces:applications to 3D reconstruction problems dealing with visibility[J]. International Journal of Computer Vision, 2011, 95(2):100-123.
[11] DELAUNOY A, POLLEFEYS M. Photometric bundle adjustment for dense multi-view 3D modeling[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Columbus:IEEE, 2014:1486-1493.
[12] VU H H, LABATUT P, PONS J P, et al. High accuracy and visibility-consistent dense multiview stereo[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(5):889-901.
[13] HEISE P, JENSEN B, KLOSE S, et al. Variational Patch-Match multiview reconstruction and refinement[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago:IEEE, 2015:882-890.
[14] LI S, SIU S Y, FANG T, et al. Efficient multi-view surface refinement with adaptive resolution control[C]//Proceedings of the 14th European Conference on Computer Vision. Amsterdam:Springer, 2016:349-364.
[15] 张春森, 张萌萌, 郭丙轩. 影像信息驱动的三角网格模型优化方法[J]. 测绘学报, 2018, 47(7):959-967. DOI:10.11947/j.AGCS.2018.20170733. ZHANG Chunsen, ZHANG Mengmeng, GUO Bingxuan. Refinement of the 3D mesh model driven by the image information[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(7):959-967. DOI:10.11947/j.AGCS.2018.20170733.
[16] MORREALE L, ROMANONI A, MATTEUCCI M. Predicting the next best view for 3D mesh refinement[C]//Proceedings of the 15th International Conference Intelligent Autonomous Systems. Berlin:Springer-Verlag, 2019:760-772.
[17] WANG C C L. Incremental reconstruction of sharp edges on mesh surfaces[J]. Computer Aided Design, 2006, 38(6):689-702.
[18] BLÁHA M, ROTHERMEL M, OSWALD M R, et al. Semantically informed multiview surface refinement[C]//Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy:IEEE, 2017:3839-3847.
[19] BÓDIS-SZOMORU' A, RIEMENSCHNEIDER H, VAN GOOL L. Superpixel meshes for fast edge-preserving surface reconstruction[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Boston:IEEE, 2015:2011-2020.
[20] LI Shiwei, YAO Yao, FANG Tian, et al. Reconstructing thin structures of manifold surfaces by integrating spatial curves[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City:IEEE, 2018:2887-2896.
[21] PONS J P, KERIVEN R, FAUGERAS O. Multi-view stereo reconstruction and scene flow estimation with a global image-based matching score[J]. International Journal of Computer Vision, 2007, 72(2):179-193.
[22] KOBBELT L, CAMPAGNA S, VORSATZ J, et al. Interactive multi-resolution modeling on arbitrary meshes[C]//Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 1998:105-114.
[23] HOFER M, MAURER M, BISCHOF H. Line3D:efficient 3D scene abstraction for the built environment[C]//Proceedings of German Conference on Pattern Recognition. Aachen:Springer-Verlag, 2015:237-248.
[24] HOFER M, MAURER M, BISCHOF H. Efficient 3D scene abstraction using line segments[J]. Computer Vision and Image Understanding, 2017, 157(4):167-178.
[25] STRECHA C, VON HANSEN W, VAN GOOL L, et al. On benchmarking camera calibration and multi-view stereo for high resolution imagery[C]//Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition. Anchorage:IEEE, 2008:1-8.

带线约束的摄影测量网格变分精化算法

Variational refinement of mesh with line constraint for photogrammetry

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	王乐洋, 赵雄, 许文斌, 汪驰升, 方楠, 谢磊. 协方差阵非负约束的赫尔默特方差分量估计[J]. 测绘学报, 2022, 51(3): 351-360.
[2]	徐焕, 于锦海, 安邦, 万晓云. 利用垂直重力梯度异常反演海底地形的解析方法[J]. 测绘学报, 2022, 51(1): 53-62.
[3]	王乐洋, 陈涛, 邹传义. 病态乘性误差模型的加权最小二乘正则化迭代解法及精度评定[J]. 测绘学报, 2021, 50(5): 589-599.
[4]	林东方, 朱建军, 付海强, 张兵. 均方误差意义下的正则化参数二次优化方法[J]. 测绘学报, 2020, 49(4): 443-451.
[5]	张春森, 张会, 郭丙轩, 彭哲. 城市场景结构感知的网格模型简化算法[J]. 测绘学报, 2020, 49(3): 334-342.
[6]	邓非, 颜青松, 肖腾. 多视密集匹配并行传播GPU-PatchMatch算法[J]. 测绘学报, 2020, 49(2): 181-190.
[7]	朱艳, 颜青松, 曲英杰, 陈欣, 邓非. 影像一致性优化的视图选取策略[J]. 测绘学报, 2020, 49(11): 1463-1472.
[8]	黄鸿, 陈美利, 王丽华, 李政英. 空-谱协同正则化稀疏超图嵌入的高光谱图像分类[J]. 测绘学报, 2019, 48(6): 676-687.
[9]	张一, 姜挺, 江刚武, 余岸竹, 于英. 特征法视觉SLAM逆深度滤波的三维重建[J]. 测绘学报, 2019, 48(6): 708-717.
[10]	范军, 李涛, 左小清, 陈乾福, 张祥, 禄競. 利用参数独立分解的星载SAR干涉测量检校方法[J]. 测绘学报, 2019, 48(6): 737-746.
[11]	刘晓刚, 孙中苗, 管斌, 范昊鹏. 航空重力测量数据向下延拓的改进Poisson积分迭代法[J]. 测绘学报, 2018, 47(9): 1188-1195.
[12]	尚洋, 孙晓亮, 张跃强, 李由, 于起峰. 三维目标位姿跟踪与模型修正[J]. 测绘学报, 2018, 47(6): 799-808.
[13]	郭飞霄, 孙中苗, 赵俊, 苗岳旺, 肖云. 附加空间约束的径向点质量模型方法反演区域地表质量变化[J]. 测绘学报, 2018, 47(5): 592-599.
[14]	袁一, 程亮, 宗雯雯, 李舒怡, 李满春. 互联网众源照片的三维重建定位技术[J]. 测绘学报, 2018, 47(5): 631-643.
[15]	王乐洋, 熊露雲. 一种Partial EIV半参数模型的系统误差处理方法[J]. 测绘学报, 2018, 47(1): 25-34.