Delaunay三角网约束下的影像稳健匹配方法

doi:10.11947/j.AGCS.2020.20190089

测绘学报 ›› 2020, Vol. 49 ›› Issue (3): 322-333.doi: 10.11947/j.AGCS.2020.20190089

Delaunay三角网约束下的影像稳健匹配方法

姜三¹, 江万寿^2,3

1. 中国地质大学(武汉)计算机学院, 湖北武汉 430074;
2. 武汉大学测绘遥感信息工程国家重点实验室, 湖北武汉 430072;
3. 武汉大学地球空间信息科学协同创新中心, 湖北武汉 430072

收稿日期:2019-03-18 修回日期:2019-10-14 发布日期:2020-03-24
通讯作者: 江万寿 E-mail:jws@whu.edu.cn
作者简介:姜三(1987-),男,博士,副研究员,研究方向为多源影像匹配和三维重建的理论与方法。E-mail:jiangsan@cug.edu.cn
基金资助:
国家自然科学基金（U1711266）

Robust image matching constrained by delaunay triangulation

JIANG San¹, JIANG Wanshou^2,3

1. School of Computer Science, China University of Geosciences, Wuhan 430074, China;
2. State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430072, China;
3. Collaborative Innovation Center of Geospatial Technology, Wuhan University, Wuhan 430072, China

Received:2019-03-18 Revised:2019-10-14 Published:2020-03-24
Supported by:
The National Natural Science Foundation of China (No. U1711266)

摘要/Abstract

摘要： 影像匹配是数字摄影测量和计算机视觉领域的关键问题。本文主要研究基于Delaunay三角网约束下的稳健影像匹配方法。首先利用Delaunay三角网对随机初始匹配点进行组织，构建分布均匀、结构稳定的局部连接关系；其次利用线段描述子和空间角度顺序建立了局部辐射和几何约束模型，并将粗差剔除问题转换为分析Delaunay三角网和对应匹配图的相似性问题；然后利用对应三角形局部约束实现匹配扩展；最后在分层策略和交叉验证策略下实现稳健影像匹配。利用3组数据集进行大量的匹配试验，结果表明本文的匹配算法即使在高外点率下依然能够实现稳健粗差剔除，得到高精度的影像匹配结果。

关键词: 数字摄影测量, 影像匹配, Delaunay三角网, 线段描述子

Abstract: Image matching is an important issue in the fields of photogrammetry and computer vision. This study exploits the usage of Delaunay triangulation for reliable image matching. First, randomly located initial matches are organized by using Delaunay triangulation, and neighboring connection relationships are established evenly and stably. Second, local photometric and geometric constraints are constructed based on the line descriptor and spatial angular order, which converts the problem of removing outliers to that of analyzing the similarity of the Delaunay triangulation and its corresponding graph. Third, a match expansion operation is implemented based on the local geometric constraint deduced from two corresponding triangles. Finally, a reliable image matching method is proposed with the assistant of the hierarchical elimination and cross-checking strategies. The proposed algorithm is verified by using three datasets, and the results demonstrate that even with high outlier ratios the proposed method can reliably remove false matches and provide match results with high precision.

Key words: digital photogrammetry, image matching, Delaunay triangulation, line descriptor

中图分类号:

P231
P208

姜三, 江万寿. Delaunay三角网约束下的影像稳健匹配方法[J]. 测绘学报, 2020, 49(3): 322-333.

JIANG San, JIANG Wanshou. Robust image matching constrained by delaunay triangulation[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(3): 322-333.

参考文献

[1] TSAI C H, LIN Y C. An accelerated image matching technique for UAV orthoimage registration[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 128:130-145.
[2] JIANG San, JIANG Wanshou. Efficient structure from motion for oblique UAV images based on maximal spanning tree expansion[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 132:140-161.
[3] 闫利, 费亮, 叶志云, 等. 大范围倾斜多视影像连接点自动提取的区域网平差法[J]. 测绘学报, 2016, 45(3):310-317, 338. DOI:10.11947/j.AGCS.2016.20140673. YAN Li, FEI Liang, YE Zhiyun, et al. Automatic tie-points extraction for triangulation of large-scale oblique multi-view images[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(3):310-317, 338. DOI:10.11947/j.AGCS.2016.20140673.
[4] 薛武, 张永生, 赵玲, 等. 增量式SFM与POS辅助光束法平差精度比较[J]. 测绘学报, 2017, 46(2):198-207. DOI:10.11947/j.AGCS.2017.20160274. XUE Wu, ZHANG Yongsheng, ZHAO Ling, et al. Compareison of the accuracy of incremental SFM with POS-aided bundle adjustment[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(2):198-207. DOI:10.11947/j.AGCS.2017.20160274.
[5] MUSIALSKI P, WONKA P, ALIAGA D G, et al. A survey of urban reconstruction[J]. Computer Graphics Forum, 2013, 32(6):146-177.
[6] HARRIS C, STEPHENS M. A combined corner and edge detector[C]//Proceedings of the 4th Alvey Vision Conference. Manchester:[s.n.], 1988.
[7] ACKERMANN F. Digital image correlation:performance and potential application in photogrammetry[J]. The Photogrammetric Record, 1984, 11(64):429-439.
[8] FISCHLER M A, BOLLES R C. Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6):381-395.
[9] CHUM O, MATAS J, KITTLER J. Locally optimized RANSAC[C]//Proceedings of the 25th DAGM Symposium on Pattern Recognition. Berlin:Springer, 2003:236-243.
[10] CHUM O, MATAS J. Matching with PROSAC-progressive sample consensus[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego:IEEE, 2005:220-226.
[11] RAGURAM R, CHUM O, POLLEFEYS M, et al. USAC:a universal framework for random sample consensus[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(8):2022-2038.
[12] LI Xinchao, LARSON M, HANJALIC A. Pairwise geometric matching for large-scale object retrieval[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston:IEEE, 2015:5153-5161.
[13] LU Luping, ZHANG Yong, TAO Pengjie. Geometrical consistency voting strategy for outlier detection in image matching[J]. Photogrammetric Engineering & Remote Sensing, 2016, 82(7):559-570.
[14] SATTLER T, LEIBE B, KOBBELT L. SCRAMSAC:improving RANSAC's efficiency with a spatial consistency filter[C]//Proceedings of 2009 IEEE 12th International Conference on Computer Vision. Kyoto:IEEE, 2009:2090-2097.
[15] HU Han, ZHU Qing, DU Zhiqiang, et al. Reliable spatial relationship constrained feature point matching of oblique aerial images[J]. Photogrammetric Engineering & Remote Sensing, 2015, 81(1):49-58.
[16] LIU Zhe, MARLET R. Virtual line descriptor and semi-local matching matching method for reliable feature correspondence[C]//British Machine Vision Conference. United Kingdom:[s.n.], 2012:16.1-16.11.
[17] LI Jiayuan, HU Qingwu, AI Mingyao. 4FP-structure:a robust local region feature descriptor[J]. Photogrammetric Engineering & Remote Sensing, 2017, 83(12):813-826.
[18] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[19] LI Yan, TSIN Y, GENC Y, et al. Object detection using 2D spatial ordering constraints[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego:IEEE, 2005:711-718.
[20] LIU Zhaoxia, AN Jubai, JING Yu. A simple and robust feature point matching algorithm based on restricted spatial order constraints for aerial image registration[J]. IEEE Transactions on Geoscience and Remote Sensing, 2012, 50(2):514-527.
[21] MIKOLAJCZYK K, SCHMID C. A performance evaluation of local descriptors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(10):1615-1630.
[22] MOISAN L, STIVAL B. A probabilistic criterion to detect rigid point matches between two images and estimate the fundamental matrix[J]. International Journal of Computer Vision, 2004, 57(3):201-218.
[23] MA Jiayi, ZHAO Ji, TIAN Jinwen, et al. Robust point matching via vector field consensus[J]. IEEE Transactions on Image Processing, 2014, 23(4):1706-1721.
[24] MA Jiayi, ZHOU Huabing, ZHAO Ji, et al. Robust feature matching for remote sensing image registration via locally linear transforming[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(12):6469-6481.
[25] IZADI M, SAEEDI P. Robust weighted graph transformation matching for rigid and nonrigid image registration[J]. IEEE Transactions on Image Processing, 2012, 21(10):4369-4382.

Delaunay三角网约束下的影像稳健匹配方法

Robust image matching constrained by delaunay triangulation

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	张传辉, 姚国标, 张力, 艾海滨, 满孝成, 黄鹏飞. 多分支网络联合的倾斜影像仿射不变特征匹配[J]. 测绘学报, 2021, 50(5): 641-651.
[2]	蓝朝桢, 卢万杰, 于君明, 徐青. 异源遥感影像特征匹配的深度学习算法[J]. 测绘学报, 2021, 50(2): 189-202.
[3]	颜金彪, 吴波, 彭馨. 顾及Gestalt邻近与简化原则的平面点集形状重建[J]. 测绘学报, 2020, 49(11): 1485-1496.
[4]	张春森, 张奇源, 郭丙轩, 薛万唱. 倾斜影像自适应初始物方面元优化匹配算法[J]. 测绘学报, 2020, 49(1): 108-116.
[5]	南轲, 齐华, 叶沅鑫. 深度卷积特征表达的多模态遥感影像模板匹配方法[J]. 测绘学报, 2019, 48(6): 727-736.
[6]	李成名, 殷勇, 武鹏达, 刘晓丽. 一种聚集性面群中毗邻区自动识别与处理方法[J]. 测绘学报, 2019, 48(3): 363-373.
[7]	袁修孝, 袁巍, 许殊, 纪艳华. 航摄影像密集匹配的研究进展与展望[J]. 测绘学报, 2019, 48(12): 1542-1550.
[8]	陈晓勇, 何海清, 周俊超, 安谱阳, 陈婷. 低空摄影测量立体影像匹配的现状与展望[J]. 测绘学报, 2019, 48(12): 1595-1603.
[9]	刘文凯, 刘启亮, 蔡建南. 自然邻域支持下的空间同位模式挖掘方法[J]. 测绘学报, 2019, 48(1): 95-105.
[10]	Yun ZHANG. 智能摄影测量和图像处理在高分辨率光学遥感影像处理中的应用——CRC-AGIP实验室的案例[J]. 测绘学报, 2018, 47(6): 722-729.
[11]	范大昭, 董杨, 张永生. 卫星影像匹配的深度卷积神经网络方法[J]. 测绘学报, 2018, 47(6): 844-853.
[12]	杨伟, 艾廷华. 轨迹分割与图层融合的车辆轨迹线构建道路地图方法[J]. 测绘学报, 2018, 47(12): 1650-1659.
[13]	梁焕青, 谢意, 付四洲. 颜色不变量与AKAZE特征相结合的无人机影像匹配算法[J]. 测绘学报, 2017, 46(7): 900-909.
[14]	张力, 艾海滨, 许彪, 孙钰珊, 董友强. 基于多视影像匹配模型的倾斜航空影像自动连接点提取及区域网平差方法[J]. 测绘学报, 2017, 46(5): 554-564.
[15]	陈小卫, 张保明, 郭海涛, 赵传, 徐俊峰. 利用自由形状线特征的遥感影像分级匹配方法[J]. 测绘学报, 2017, 46(2): 208-217.