多视纹理映射中无需设定偏差的快速可见性检测

doi:10.11947/j.AGCS.2020.20180468

测绘学报 ›› 2020, Vol. 49 ›› Issue (1): 92-107.doi: 10.11947/j.AGCS.2020.20180468

多视纹理映射中无需设定偏差的快速可见性检测

黄翔翔, 朱全生, 江万寿

武汉大学测绘遥感信息工程国家重点实验室, 湖北武汉 430079

收稿日期:2018-10-12 修回日期:2019-08-02 发布日期:2020-01-16
通讯作者: 江万寿 E-mail:jws@whu.edu.cn
作者简介:黄翔翔(1987-),男,博士,研究方向为摄影测量、计算机视觉以及计算机图形学。E-mail:huangxiangxiang@whu.edu.cn
基金资助:
南方电网科技项目（GDKJQQ20161187）

Fast visibility detection without specifying the user-defined biases in multi-view texture mapping

HUANG Xiangxiang, ZHU Quansheng, JIANG Wanshou

State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

Received:2018-10-12 Revised:2019-08-02 Published:2020-01-16
Supported by:
China Southern Power Grid Technology Project(No. GDKJQQ20161187)

摘要/Abstract

摘要： 在多视纹理映射中，Z缓冲区算法和光线追踪算法是两种主流的可见性检测算法。但其精度受限于人工设定的偏差。本文提出一种无需设定偏差的可见性检测方案。首先，根据倾斜摄影的投影参数设计了一种基于着色器编程的影像模拟算法，生成各影像视角下的初始可见性图（initial visibility map，IVM）。其中，完全不可见面元在模拟的过程中会被深度测试自动剔除。然后，基于矢量栅格化准则和像素深度对IVM中的可见面元执行投影区域优化（projection coverage refinement，PCR）。最后，提出惰性投影（lazy projection，LP）和迭代点边采样（iterative vertex-edge sampling，IVES）快速区分出IVM中的完全可见面元和非完全可见面元。利用两个数据集对本文算法进行了论证。结果表明本文算法的效率和精度均优于主流算法。

关键词: 可见性计算, 遮挡检测, 多视纹理重建, 倾斜摄影, 图形渲染管道

Abstract: The Z-buffer and ray-tracing algorithms are the two popular approaches used in visibility handling for multi-view based texture mapping. However, the accuracies of the two algorithms are limited by the user-defined biases. We propose a solution in which no biases are specified. First, a shader-based rendering is designed according to the projection parameter of oblique photogrammetry to generate each view's initial visibility map (IVM). The fully occluded primitives will be excluded by the depth test of graphics pipeline.Second, projection coverage refinement (PCR) is given to the visible primitives in IVM based on vector rasterization criterion and pixel depth. Last, lazy projection (LP) and iterative vertex-edge sampling (IVES) are proposed to distinguish the partially visible and fully visible primitives. We use two datasets to prove our method's validity. The experimental results show that our method has a better performance than the mainstream algorithm.

Key words: visibility computation, occlusion detection, multiview-based texture reconstruction, oblique photogrammetry, computer graphics pipeline

中图分类号:

P227

黄翔翔, 朱全生, 江万寿. 多视纹理映射中无需设定偏差的快速可见性检测[J]. 测绘学报, 2020, 49(1): 92-107.

HUANG Xiangxiang, ZHU Quansheng, JIANG Wanshou. Fast visibility detection without specifying the user-defined biases in multi-view texture mapping[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(1): 92-107.

参考文献

[1] FRUEH C, SAMMON R, ZAKHOR A. Automated texture mapping of 3D city models with oblique aerial imagery[C]//Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission. Thessaloniki, Greece:IEEE, 2004:396-403.
[2] XU Lin, LI E, LI Jianguo, et al. A general texture mapping framework for image-based 3D modeling[C]//Proceedings of the 2010 IEEE International Conference on Image Processing. Hong Kong, China:IEEE, 2010:2713-2716.
[3] KATZ S, TAL A, BASRI R. Direct visibility of point sets[J]. ACM Transactions on Graphics, 2007, 26(3):Article No. 24.
[4] PAGÉS R, BERJÓN D, MORÁN F, et al. Seamless, static multi-texturing of 3D meshes[J]. Computer Graphics Forum, 2015, 34(1):228-238.
[5] ZHANG Weilong, LI Ming, GUO Bingxuan, et al. Rapid texture optimization of three-dimensional urban model based on oblique images[J]. Sensors, 2017, 17(4):911.
[6] WAECHTER M, MOEHRLE N, GOESELE M. Let there be color! Large-scale texturing of 3D reconstructions[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland:Springer, 2014:836-850.
[7] PINTUS R, GOBBETTI E, CALLIERI M, et al. Techniques for seamless color registration and mapping on dense 3D models[M]//MASINI N, SOLDOVIERI F. Sensing the Past. Geotechnologies and the Environment, vol 16.[S.l.]:Springer, 2017:355-376.
[8] BAUMBERG A. Blending images for texturing 3D models[C]//Proceedings of the British Machine Vision Conference. Cardiff, UK:BMVA Press, 2002:38.1-38.10.
[9] BERNARDINI F, MARTIN I M, RUSHMEIER H. High-quality texture reconstruction from multiple scans[J]. IEEE Transactions on Visualization and Computer Graphics, 2001, 7(4):318-332.
[10] CALLIERI M, CIGNONI P, CORSINI M, et al. Masked photo blending:mapping dense photographic data set on high-resolution sampled 3D models[J]. Computers & Graphics, 2008, 32(4):464-473.
[11] ROCCHINI C, CIGNONI P, MONTANI C, et al. Multiple textures stitching and blending on 3D objects[C]//Proceedings of the 10th Eurographics Workshop on Rendering. Granada, Spain:The Eurographics Association, 1999.
[12] WEGHORST H, HOOPER G, GREENBERG D P. Improved computational methods for ray tracing[J]. ACM Transactions on Graphics, 1984, 3(1):52-69.
[13] GLASSNER A S. Space subdivision for fast ray tracing[J]. IEEE Computer Graphics and Applications, 1984, 4(10):15-24.
[14] FRANKLIN W R, CHANDRASEKHAR N, KANKANHALLI M, et al. Efficiency of uniform grids for intersection detection on serial and parallel machines[C]//Proceedings of the New Trends in Computer Graphics. Berlin, Heidelberg:Springer, 1988:288-297.
[15] YU B T W, YU W W H. Image space subdivision for fast ray tracing[C]//Proceedings of the SPIE's International Symposium on Optical Science, Engineering, and Instrumentation. Denver, CO, United States:SPIE, 1999.
[16] GREENE N, KASS M, MILLER G. Hierarchical Z-buffer visibility[C]//Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques. Anaheim, CA:ACM, 1993:231-238.
[17] WAND M, FISCHER M, PETER I, et al. The randomized z-buffer algorithm:interactive rendering of highly complex scenes[C]//Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 2001:360-370.
[18] WILLIAMS L. Casting curved shadows on curved surfaces[J]. ACM SIGGRAPH Computer Graphics, 1978, 12(3):270-274.
[19] ANNEN T, MERTENS T, SEIDEL H P, et al. Exponential shadow maps[C]//Proceedings of the Graphics Interface. Windsor, Ontario, Canada:ACM, 2008:155-161.
[20] DOU H, YAN Y J, KERZNER E, et al. Adaptive depth bias for shadow maps[C]//Proceedings of the 18th meeting of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. San Francisco, California:ACM, 2014:97-102.
[21] 李明, 张卫龙, 范丁元. 城市三维重建中的自动纹理优化方法[J]. 测绘学报, 2017, 46(3):338-345. DOI:10.11947/j.AGCS.2017.20160467. LI Ming, ZHANG Weilong, FAN Dingyuan. Automatic texture optimization for 3D urban reconstruction[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(3):338-345. DOI:10.11947/j.AGCS.2017.20160467.
[22] 张春森, 张卫龙, 郭丙轩, 等. 倾斜影像的三维纹理快速重建[J]. 测绘学报, 2015, 44(7):782-790. DOI:10.11947/j.AGCS.2015.20140341. ZHANG Chunsen, ZHANG Weilong, GUO Bingxuan, et al. Rapidly 3D texture reconstruction based on oblique photography[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(7):782-790. DOI:10.11947/j.AGCS.2015.20140341.
[23] FLORIANI L, MAGILLO P. Algorithms for visibility computation on terrains:a survey[J]. Environment & Planning B:Planning & Design, 2003, 30(5):709-728.
[24] GEVA A. ColDet 3D collision detection[EB/OL].[2013-05-20].https://sourceforge.net/projects/coldet.
[25] WAECHTER C, KELLER A. Quasi-monte carlo light transport simulation by efficient ray tracing:United States, 7952583[P]. 2011-05-31.
[26] BITTNER J, WONKA P. Visibility in computer graphics[J]. Environment & Planning B:Planning & Design, 2003, 30(5):729-755.
[27] PERSSON E, STUDIOS A. Creating vast game worlds:experiences from Avalanche Studios[C]//Proceedings of the ACM SIGGRAPH 2012 Talks. Los Angeles, California, USA:ACM, 2012:Article No. 32.
[28] SZELISKI R, ZABIH R, SCHARSTEIN D, et al. A comparative study of energy minimization methods for markov random fields[C]//European Conference on Computer Vision. Berlin Heidelberg:Springer, 2006:16-29.
[29] BOYKOV Y, VEKSLER O, ZABIH R. Fast approximate energy minimization via graph cuts[C]//Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra, Greece:IEEE, 1999:377-384.
[30] KOLMOGOROV V, ZABIH R. What energy functions can be minimized via graph cuts?[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2004, 26(2):147-159.
[31] PINEDA J. A parallel algorithm for polygon rasterization[C]//Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 1988:17-20.
[32] 张祖勋, 苏国中, 郑顺义, 等. OpenGL成像机理及其与摄影测量方位元素的相关分析[J]. 武汉大学学报(信息科学版), 2004, 29(7):570-574. ZHANG Zuxun, SU Guozhong, ZHENG Shunyi, et al. Relating OpenGL imaging process with exterior and interior parameters of photogrammetry[J]. Geomatics and Information Science of Wuhan University, 2004, 29(7):570-574.
[33] SEGAl Mark,AKELEY Kurt. The opengl graphics system:a specification (Version 4.5)[EB/OL].[2017-06-29]. https://www.khronos.org/registry/OpenGL/specs/gl/glspec45.core.pdf.
[34] DAVIDOVIČ T, ENGELHARDT T, GEORGIEV I, et al. 3D rasterization:a bridge between rasterization and ray casting[C]//Proceedings of the Graphics Interface 2012. Toronto, Ontario, Canada:ACM, 2012:201-208.
[35] LI S Z. Markov random field models in computer vision[C]//Proceedings of the European Conference on Computer Vision. Berlin, Heidelberg:Springer, 1994:361-370.
[36] GREIG D M, PORTEOUS B T, SEHEULT A H. Exact maximum A Posteriori estimation for binary images[J]. Journal of the Royal Statistical Society:Series B (Methodological)s, 1989, 51(2):271-279.

多视纹理映射中无需设定偏差的快速可见性检测

Fast visibility detection without specifying the user-defined biases in multi-view texture mapping

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 8

编辑推荐

Metrics

本文评价

[1]	李清泉, 黄惠, 姜三, 胡庆武, 于文率. 优视摄影测量方法及精度分析[J]. 测绘学报, 2022, 51(6): 996-1007.
[2]	汪利斌, 胡翰, 朱庆, 丁雨淋, 陈敏. 局部表面参数化的实景三角网模型语义增强方法[J]. 测绘学报, 2020, 49(2): 225-234.
[3]	李明, 张卫龙, 范丁元. 城市三维重建中的自动纹理优化方法[J]. 测绘学报, 2017, 46(3): 338-345.
[4]	李加元, 胡庆武, 艾明耀. 以重心坐标为基准的空间后方交会非迭代法[J]. 测绘学报, 2015, 44(9): 988-994.
[5]	肖卫峰张良孙大鹏李月锋. 光线追踪遮挡检测算法[J]. 测绘学报, 2014, 43(8): 862-868.
[6]	王竞雪朱庆王伟玺. 多匹配基元集成的多视影像密集匹配方法[J]. , 2013, 42(5): 691-698.
[7]	钟成,黄先锋. 真正射影像生成的多边形反演成像遮蔽检测方法[J]. 测绘学报, 2010, 39(1): 0-82.
[8]	谢文寒,周国清. 城市大比例尺真正射影像阴影与遮挡问题的研究[J]. 测绘学报, 2010, 39(1): 0-82.