Oblique image matching algorithm based on adaptive initial object patch

doi:10.11947/j.AGCS.2020.20190050

Abstract

Abstract: In order to solve the problem of low degree of image connection points and too few aero triangulation points with large depth discontinuity or difference when using the least square image matching method based on object patch to match oblique images, an algorithm of oblique image matching based on adaptive initial object patch is proposed. The algorithm uses the initial values of interior and exterior orientation elements of the oblique image and the object points generated in the matching process, and adaptively calculates the elevation of the object patch and the initial value of the normal vector direction angle by the method of multi-patch forward intersection and object variance partition. Then it solves the problem that the low accuracy initial value of the oblique image with the least squares image matching method of the object patch is not easily matched to corresponding points when matching the oblique image. Finally, two groups of oblique images are matched by the proposed method and the least square image matching method, in which the initial state of the object patch is horizontal object patch, respectively, to verify the effectiveness of the proposed method.

Key words: oblique image matching, least-square, homograph matrix, adaptive initial object patch

CLC Number:

P231

ZHANG Chunsen, ZHANG Qiyuan, GUO Bingxuan, XUE Wanchang. Oblique image matching algorithm based on adaptive initial object patch[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(1): 108-116.

References

[1] GRUEN A. Development and status of image matching in photogrammetry[J]. The Photogrammetric Record, 2012, 27(137):36-57.
[2] 李德仁, 肖雄武, 郭丙轩, 等. 倾斜影像自动空三及其在城市真三维模型重建中的应用[J]. 武汉大学学报(信息科学版), 2016, 41(6):711-721. LI Deren, XIAO Xiongwu, GUO Bingxuan, et al. Oblique image based automatic aerotriangulation and its application in 3D city model reconstruction[J]. Geomatics and Information Science of Wuhan University, 2016, 41(6):711-721.
[3] 张卡, 盛业华, 付素霞, 等. 基于物方定位一致性约束的光学航空影像多视铅垂线轨迹匹配[J]. 光学精密工程, 2018, 26(7):1784-1792. ZHANG Ka, SHENG Yehua, FU Suxia, et al. Multi-view VLL matching algorithm for optical aerial images based on constraint of object space positioning consistency[J]. Optics and Precision Engineering, 2018, 26(7):1784-1792.
[4] 江万寿, 郑顺义, 张祖勋, 等. 航空影像特征匹配研究[J]. 武汉大学学报(信息科学版), 2003, 28(5):510-513. JIANG Wanshou, ZHENG Shunyi, ZHANG Zuxun, et al. Feature-based image matching for aerial images[J]. Geomatics and Information Science of Wuhan University, 2003, 28(5):510-513.
[5] 纪华, 吴元昊, 孙宏海, 等. 结合全局信息的SIFT特征匹配算法[J]. 光学精密工程, 2009, 17(2):439-444. JI Hua, WU Yuanhao, SUN Honghai, et al. SIFT feature matching algorithm with global information[J]. Optics and Precision Engineering, 2009, 17(2):439-444.
[6] 纪松, 张永生, 范大昭, 等. 基于特征点引导的多视影像择优匹配方法[J]. 武汉大学学报(信息科学版), 2018, 43(1):37-45. JI Song, ZHANG Yongsheng, FAN Dazhao, et al. A stereo selecting method of multi-view matching models guided based on feature points[J]. Geomatics and Information Science of Wuhan University, 2018, 43(1):37-45.
[7] 郑顺义, 张祖勋, 张剑清. 基于物方影像匹配和概率松弛的断面自动提取[J]. 测绘信息与工程, 2004, 29(2):26-27. ZHENG Shunyi, ZHANG Zuxun, ZHANG Jianqing. Automatic profile extraction based on object space image matching and probability relaxation algorithm[J]. Journal of Geomatics, 2004, 29(2):26-27.
[8] ZHANG Li, GRUEN A. Multi-image matching for DSM generation from IKONOS imagery[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2006, 60(3):195-211.
[9] 纪松, 范大昭, 张永生, 等. 多视匹配MVLL算法及其在ADS40线阵影像中的运用[J]. 武汉大学学报(信息科学版), 2009, 34(1):28-31. JI Song, FAN Dazhao, ZHANG Yongsheng, et al. MVLL multi-image matching model and its application in ADS40 linear array images[J]. Geomatics and Information Science of Wuhan University, 2009, 34(1):28-31.
[10] 王竞雪, 朱庆, 王伟玺. 多匹配基元集成的多视影像密集匹配方法[J]. 测绘学报, 2013, 42(5):691-698. WANG Jingxue, ZHU Qing, WANG Weixi. A dense matching algorithm of multi-view image based on the integrated multiple matching primitives[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(5):691-698.
[11] BALTSAVIAS E P. Multiphoto geometrically constrained matching[D]. Zurich:ETH, 1991.
[12] 江万寿. 航空影像多视匹配与规则建筑物自动提取方法研究[D]. 武汉:武汉大学, 2004. JIANG Wanshou. Multiple aerial image matching and automatic building detection[D]. Wuhan:Wuhan University, 2004.
[13] 张过, 陈钽, 潘红播, 等. 基于有理多项式系数模型的物方面元最小二乘匹配[J]. 测绘学报, 2011, 40(5):592-597. ZHANG Guo, CHEN Tan, PAN Hongbo, et al. Patch-based least squares image matching based on rational polynomial coefficients model[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(5):592-597.
[14] 张卡, 盛业华, 孟微波, 等. 基于多视影像匹配的三维彩色点云自动生成[J]. 光学精密工程, 2013, 21(7):1840-1849. ZHANG Ka, SHENG Yehua, MENG Weibo, et al. Automatic generation of three dimensional colored point clouds based on multi-view image matching[J]. Optics and Precision Engineering, 2013, 21(7):1840-1849.
[15] 杨楠, 邵振峰, 郭丙轩, 等. 基于非固定初始面元的无人机影像点云优化算法[J]. 武汉大学学报(信息科学版), 2016, 41(8):1013-1020. YANG Nan, SHAO Zhenfeng, GUO Bingxuan, et al. Point cloud optimization for UAV image based on non-fixed initial patch[J]. Geomatics and Information Science of Wuhan University, 2016, 41(8):1013-1020.
[16] 唐敏, 李永树, 鲁恒. 无人机影像的同名点匹配[J]. 光电工程, 2012, 39(3):19-24. TANG Min, LI Yongshu, LU Heng. Correspondence points matching of UAV images[J]. Opto-Electronic Engineering, 2012, 39(3):19-24.
[17] 明洋. 特殊航空影像自动匹配的关键技术研究[D]. 武汉:武汉大学, 2009. MING Yang. Research on key technologies of automatic image matching for special aerial images[D]. Wuhan:Wuhan University, 2009.
[18] 李琳慧. 基于自适应物方面元的无人机多视影像密集匹配算法[D]. 武汉:武汉大学, 2011. LI Linhui. Multi-view image dense matching algorithm for UAV based on adaptive matter-aspect element[D]. Wuhan:Wuhan University, 2011.
[19] 王伟, 黄雯雯, 镇姣. Pictometry倾斜摄影技术及其在3维城市建模中的应用[J]. 测绘与空间地理信息, 2011, 34(3):181-183. WANG Wei, HUANG Wenwen, ZHEN Jiao. Pictometry oblique photography technique and its application in 3D city modeling[J]. Geomatics & Spatial Information Technology, 2011, 34(3):181-183.
[20] 张祖勋, 张剑清, 胡翔云. 基于物方空间几何约束最小二乘匹配的建筑物半自动提取方法[J]. 武汉大学学报(信息科学版), 2001, 26(4):290-295. ZHANG Zuxun, ZHANG Jianqing, HU Xiangyun. Semiautomatic building extraction by least squares matching based on geometrical constraints in object space[J]. Geomatics and Information Science of Wuhan University, 2001, 26(4):290-295.
[21] 林青, 范晶晶, 胡波. 多摄像头目标跟踪动态单应投影方法研究[J]. 复旦学报(自然科学版), 2011, 50(4):501-510. LIN Qing, FAN Jingjing, HU Bo. Dynamic homography method for multi-camera target tracking[J]. Journal of Fudan University (Natural Science), 2011, 50(4):501-510.
[22] 肖雄武, 李德仁, 郭丙轩, 等. 一种具有视点不变性的倾斜影像快速匹配方法[J]. 武汉大学学报(信息科学版), 2016, 41(9):1151-1159. XIAO Xiongwu, LI Deren, GUO Bingxuan, et al. A robust and rapid viewpoint-invariant matching method for oblique images[J]. Geomatics and Information Science of Wuhan University, 2016, 41(9):1151-1159.
[23] FURUKAWA Y, PONCE J. Accurate, dense, and robust multiview stereopsis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376.
[24] YU Yinan, HUANG Kaiqi, CHEN Wei, et al. A novel algorithm for view and illumination invariant image matching[J]. IEEE Transactions on Image Processing, 2012, 21(1):229-240.
[25] YANG Huachao, ZHANG Shubi, WANG Yongbo. Robust and precise registration of oblique images based on scale-invariant feature transformation algorithm[J]. IEEE Geoscience and Remote Sensing Letters, 2012, 9(4):783-787.