Fast visibility detection without specifying the user-defined biases in multi-view texture mapping

doi:10.11947/j.AGCS.2020.20180468

Abstract

Abstract: The Z-buffer and ray-tracing algorithms are the two popular approaches used in visibility handling for multi-view based texture mapping. However, the accuracies of the two algorithms are limited by the user-defined biases. We propose a solution in which no biases are specified. First, a shader-based rendering is designed according to the projection parameter of oblique photogrammetry to generate each view's initial visibility map (IVM). The fully occluded primitives will be excluded by the depth test of graphics pipeline.Second, projection coverage refinement (PCR) is given to the visible primitives in IVM based on vector rasterization criterion and pixel depth. Last, lazy projection (LP) and iterative vertex-edge sampling (IVES) are proposed to distinguish the partially visible and fully visible primitives. We use two datasets to prove our method's validity. The experimental results show that our method has a better performance than the mainstream algorithm.

Key words: visibility computation, occlusion detection, multiview-based texture reconstruction, oblique photogrammetry, computer graphics pipeline

CLC Number:

P227

HUANG Xiangxiang, ZHU Quansheng, JIANG Wanshou. Fast visibility detection without specifying the user-defined biases in multi-view texture mapping[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(1): 92-107.

References

[1] FRUEH C, SAMMON R, ZAKHOR A. Automated texture mapping of 3D city models with oblique aerial imagery[C]//Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission. Thessaloniki, Greece:IEEE, 2004:396-403.
[2] XU Lin, LI E, LI Jianguo, et al. A general texture mapping framework for image-based 3D modeling[C]//Proceedings of the 2010 IEEE International Conference on Image Processing. Hong Kong, China:IEEE, 2010:2713-2716.
[3] KATZ S, TAL A, BASRI R. Direct visibility of point sets[J]. ACM Transactions on Graphics, 2007, 26(3):Article No. 24.
[4] PAGÉS R, BERJÓN D, MORÁN F, et al. Seamless, static multi-texturing of 3D meshes[J]. Computer Graphics Forum, 2015, 34(1):228-238.
[5] ZHANG Weilong, LI Ming, GUO Bingxuan, et al. Rapid texture optimization of three-dimensional urban model based on oblique images[J]. Sensors, 2017, 17(4):911.
[6] WAECHTER M, MOEHRLE N, GOESELE M. Let there be color! Large-scale texturing of 3D reconstructions[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland:Springer, 2014:836-850.
[7] PINTUS R, GOBBETTI E, CALLIERI M, et al. Techniques for seamless color registration and mapping on dense 3D models[M]//MASINI N, SOLDOVIERI F. Sensing the Past. Geotechnologies and the Environment, vol 16.[S.l.]:Springer, 2017:355-376.
[8] BAUMBERG A. Blending images for texturing 3D models[C]//Proceedings of the British Machine Vision Conference. Cardiff, UK:BMVA Press, 2002:38.1-38.10.
[9] BERNARDINI F, MARTIN I M, RUSHMEIER H. High-quality texture reconstruction from multiple scans[J]. IEEE Transactions on Visualization and Computer Graphics, 2001, 7(4):318-332.
[10] CALLIERI M, CIGNONI P, CORSINI M, et al. Masked photo blending:mapping dense photographic data set on high-resolution sampled 3D models[J]. Computers & Graphics, 2008, 32(4):464-473.
[11] ROCCHINI C, CIGNONI P, MONTANI C, et al. Multiple textures stitching and blending on 3D objects[C]//Proceedings of the 10th Eurographics Workshop on Rendering. Granada, Spain:The Eurographics Association, 1999.
[12] WEGHORST H, HOOPER G, GREENBERG D P. Improved computational methods for ray tracing[J]. ACM Transactions on Graphics, 1984, 3(1):52-69.
[13] GLASSNER A S. Space subdivision for fast ray tracing[J]. IEEE Computer Graphics and Applications, 1984, 4(10):15-24.
[14] FRANKLIN W R, CHANDRASEKHAR N, KANKANHALLI M, et al. Efficiency of uniform grids for intersection detection on serial and parallel machines[C]//Proceedings of the New Trends in Computer Graphics. Berlin, Heidelberg:Springer, 1988:288-297.
[15] YU B T W, YU W W H. Image space subdivision for fast ray tracing[C]//Proceedings of the SPIE's International Symposium on Optical Science, Engineering, and Instrumentation. Denver, CO, United States:SPIE, 1999.
[16] GREENE N, KASS M, MILLER G. Hierarchical Z-buffer visibility[C]//Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques. Anaheim, CA:ACM, 1993:231-238.
[17] WAND M, FISCHER M, PETER I, et al. The randomized z-buffer algorithm:interactive rendering of highly complex scenes[C]//Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 2001:360-370.
[18] WILLIAMS L. Casting curved shadows on curved surfaces[J]. ACM SIGGRAPH Computer Graphics, 1978, 12(3):270-274.
[19] ANNEN T, MERTENS T, SEIDEL H P, et al. Exponential shadow maps[C]//Proceedings of the Graphics Interface. Windsor, Ontario, Canada:ACM, 2008:155-161.
[20] DOU H, YAN Y J, KERZNER E, et al. Adaptive depth bias for shadow maps[C]//Proceedings of the 18th meeting of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. San Francisco, California:ACM, 2014:97-102.
[21] 李明, 张卫龙, 范丁元. 城市三维重建中的自动纹理优化方法[J]. 测绘学报, 2017, 46(3):338-345. DOI:10.11947/j.AGCS.2017.20160467. LI Ming, ZHANG Weilong, FAN Dingyuan. Automatic texture optimization for 3D urban reconstruction[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(3):338-345. DOI:10.11947/j.AGCS.2017.20160467.
[22] 张春森, 张卫龙, 郭丙轩, 等. 倾斜影像的三维纹理快速重建[J]. 测绘学报, 2015, 44(7):782-790. DOI:10.11947/j.AGCS.2015.20140341. ZHANG Chunsen, ZHANG Weilong, GUO Bingxuan, et al. Rapidly 3D texture reconstruction based on oblique photography[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(7):782-790. DOI:10.11947/j.AGCS.2015.20140341.
[23] FLORIANI L, MAGILLO P. Algorithms for visibility computation on terrains:a survey[J]. Environment & Planning B:Planning & Design, 2003, 30(5):709-728.
[24] GEVA A. ColDet 3D collision detection[EB/OL].[2013-05-20].https://sourceforge.net/projects/coldet.
[25] WAECHTER C, KELLER A. Quasi-monte carlo light transport simulation by efficient ray tracing:United States, 7952583[P]. 2011-05-31.
[26] BITTNER J, WONKA P. Visibility in computer graphics[J]. Environment & Planning B:Planning & Design, 2003, 30(5):729-755.
[27] PERSSON E, STUDIOS A. Creating vast game worlds:experiences from Avalanche Studios[C]//Proceedings of the ACM SIGGRAPH 2012 Talks. Los Angeles, California, USA:ACM, 2012:Article No. 32.
[28] SZELISKI R, ZABIH R, SCHARSTEIN D, et al. A comparative study of energy minimization methods for markov random fields[C]//European Conference on Computer Vision. Berlin Heidelberg:Springer, 2006:16-29.
[29] BOYKOV Y, VEKSLER O, ZABIH R. Fast approximate energy minimization via graph cuts[C]//Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra, Greece:IEEE, 1999:377-384.
[30] KOLMOGOROV V, ZABIH R. What energy functions can be minimized via graph cuts?[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2004, 26(2):147-159.
[31] PINEDA J. A parallel algorithm for polygon rasterization[C]//Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques. New York:ACM, 1988:17-20.
[32] 张祖勋, 苏国中, 郑顺义, 等. OpenGL成像机理及其与摄影测量方位元素的相关分析[J]. 武汉大学学报(信息科学版), 2004, 29(7):570-574. ZHANG Zuxun, SU Guozhong, ZHENG Shunyi, et al. Relating OpenGL imaging process with exterior and interior parameters of photogrammetry[J]. Geomatics and Information Science of Wuhan University, 2004, 29(7):570-574.
[33] SEGAl Mark,AKELEY Kurt. The opengl graphics system:a specification (Version 4.5)[EB/OL].[2017-06-29]. https://www.khronos.org/registry/OpenGL/specs/gl/glspec45.core.pdf.
[34] DAVIDOVIČ T, ENGELHARDT T, GEORGIEV I, et al. 3D rasterization:a bridge between rasterization and ray casting[C]//Proceedings of the Graphics Interface 2012. Toronto, Ontario, Canada:ACM, 2012:201-208.
[35] LI S Z. Markov random field models in computer vision[C]//Proceedings of the European Conference on Computer Vision. Berlin, Heidelberg:Springer, 1994:361-370.
[36] GREIG D M, PORTEOUS B T, SEHEULT A H. Exact maximum A Posteriori estimation for binary images[J]. Journal of the Royal Statistical Society:Series B (Methodological)s, 1989, 51(2):271-279.