联合共线约束与匹配冗余的组直线匹配结果检核算法

doi:10.11947/j.AGCS.2020.20190123

测绘学报 ›› 2020, Vol. 49 ›› Issue (6): 746-756.doi: 10.11947/j.AGCS.2020.20190123

联合共线约束与匹配冗余的组直线匹配结果检核算法

王竞雪^1,2, 刘肃艳¹, 王伟玺³

1. 辽宁工程技术大学测绘与地理科学学院, 辽宁阜新 123000;
2. 西南交通大学地球科学与环境工程学院, 四川成都 611756;
3. 深圳大学智慧城市研究院, 广东深圳 518060

收稿日期:2019-04-12 修回日期:2020-02-19 出版日期:2020-06-20 发布日期:2020-06-28
作者简介:王竞雪(1981-),女,博士,副教授,研究方向为数字影像特征匹配。E-mail:xiaoxue1861@163.com
基金资助:
国家自然科学基金（41871379；41971354）

A checking algorithm for pair-wise line matching based on collinearity constraint and matching redundancy

WANG Jingxue^1,2, LIU Suyan¹, WANG Weixi³

1. School of Geomatics,Liaoning Technical University,Fuxin 123000,China;
2. Faculty of Geosciences and Environmental Engineering,Southwest Jiaotong University,Chengdu 611756,China;
3. Research Institute for Smart Cities,Shenzhen University,Shenzhen 518060,China

Received:2019-04-12 Revised:2020-02-19 Online:2020-06-20 Published:2020-06-28
Supported by:
The National Natural Science Foundation of China (Nos. 41871379;41971354)

摘要/Abstract

摘要： 针对“一对多”“多对一”“多对多”直线匹配结果难以检核的瓶颈问题，提出一种共线约束与匹配冗余的组直线匹配结果检核算法。该算法在已有组直线匹配结果基础上，首先将结果中的每对同名直线组分裂为两对同名单直线，分别建立直线组、单直线同名对应关系矩阵，矩阵的行、列号分别对应参考影像、搜索影像上直线组索引或单直线索引，矩阵元素值可用于记录其行、列号所表示对应关系出现的数目、特征相似性系数等多源信息；在此基础上，以同名直线关系矩阵为基础，提取局部关系矩阵，建立“一对多”“多对一”“多对多”匹配结果间的关联；然后基于局部关系矩阵，结合共线约束、匹配冗余、特征相似性系数对结果进行检核，剔除错误匹配，保留正确匹配；最后对结果中的“多”直线进行拟合得到“一对一”的同名直线。选取具有典型纹理特征的航空影像和近景影像进行组直线匹配结果检核试验，获得了可靠的同名直线，验证了本文算法的有效性。

关键词: 直线匹配, 组直线匹配, 结果检核, 匹配冗余, 关系矩阵

Abstract: A checking algorithm for pair-wise line matching is proposed to solve the problems of one-to-many, many-to-one and many-to-many in line segment matching by combining collinearity constraint and matching redundancy. The proposed method is performed on pair-wise line matches generated from existing method. Firstly, individual line segment matches are obtained based on pair-wise line matches. A relation matrix is constructed for pair-wise line matches and individual line segment matches, respectively. In each relation matrix, row and column numbers correspond to the indexes of matching primitives on the reference and searching images respectively. Each matrix element can be used to record the number of matches, feature similarity or some other multi-source information corresponding to the current row and column. Secondly, the corresponding relation of one-to-many, many-to-one and many-to-many matches is established on the basis of local relation matrix which is extracted from the aforementioned relation matrix. Then, the local relation matrix is combined with collinearity constraint, matching redundancy and feature similarity to identify and eliminate outliers in the matching results. Finally, the breaking lines in the results are fitted to produce one-to-one line segment correspondences. The proposed algorithm is evaluated on digital aerial images and close-images with typical texture features. The experimental results demonstrate the effectiveness of the proposed algorithm in pair-wise line matching result checking.

Key words: line matching, pair-wise line matching, results checking, matching redundancy, relation matrix

中图分类号:

P237

王竞雪, 刘肃艳, 王伟玺. 联合共线约束与匹配冗余的组直线匹配结果检核算法[J]. 测绘学报, 2020, 49(6): 746-756.

WANG Jingxue, LIU Suyan, WANG Weixi. A checking algorithm for pair-wise line matching based on collinearity constraint and matching redundancy[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(6): 746-756.

参考文献 28

[1]	李畅, 刘亚文, 胡敏, 等. 面向街景立面三维重建的近景影像直线匹配方法研究[J]. 武汉大学学报(信息科学版), 2010, 35(12):1461-1465. LI Chang, LIU Yawen, HU Min, et al. Study on street elevation 3D reconstruction-oriented straight line matching for close-range images[J]. Geomatics and Information Science of Wuhan University, 2010, 35(12):1461-1465.
[2]	ZHANG Yongjun, ZHANG Zuxun, ZHANG Jianqing, et al. 3D building modelling with digital map, LiDAR data and video image sequences[J]. The Photogrammetric Record, 2005, 20(111):285-302.
[3]	高新凯. 基于几何不变量的直线匹配与三维建模[D]. 大连:大连理工大学, 2017. GAO Xinkai. Line matching and 3D modeling using geometric invariants[D]. Dalian:Dalian University of Technology, 2017.
[4]	邓刘洋, 沈占锋, 柯映明. 城市建成区遥感影像边界提取与扩张分析[J]. 地球信息科学学报, 2018, 20(7):996-1003. DENG Liuyang, SHEN Zhanfeng, KE Yingming. Built-up area extraction and urban expansion analysis based on remote sensing images[J]. Journal of Geo-Information Science, 2018, 20(7):996-1003.
[5]	黄良明, 彭立中, 程民德. 利用几何代数进行线段模型匹配和运动估计[J]. 中国图象图形学报, 2001, 6(3):270-274. HUANG Liangming, PENG Lizhong, CHENG Minde. Matching and estimating motion of line model using geometric algebra[J]. Journal of Image and Graphics, 2001, 6(3):270-274.
[6]	邵振峰, 陈敏. 尺度、旋转以及亮度稳健的高分辨率影像直线特征匹配[J]. 光学精密工程, 2013, 21(3):790-798. SHAO Zhenfeng, CHEN Min. Line-based matching for high-resolution images with robustness for scale, rotation and illumination[J]. Optics and Precision Engineering, 2013, 21(3):790-798.
[7]	张云生, 朱庆, 吴波, 等. 一种基于三角网约束的立体影像线特征多级匹配方法[J]. 武汉大学学报(信息科学版), 2013, 38(5):522-527. ZHANG Yunsheng, ZHU Qing, WU Bo, et al. A hierarchical stereo line matching method based on a triangle constraint[J]. Geomatics and Information Science of Wuhan University, 2013, 38(5):522-527.
[8]	张云生. 自适应三角形约束的多基元多视影像匹配方法[D]. 武汉:武汉大学, 2011. ZHANG Yunsheng. A multi-primitive and multi-view image matching method based on self-adaptive triangle constraint[D]. Wuhan:Wuhan University, 2011.
[9]	刘亚文. 基于TIN的半自动多影像同名线段匹配算法研究[J]. 武汉大学学报(信息科学版), 2004, 29(4):342-345. LIU Yawen. A semi-automatic algorithm for line matching based on delaunay triangulation[J]. Geomatics and Information Science of Wuhan University, 2004, 29(4):342-345.
[10]	HARTLEY R I. A linear method for reconstruction from lines and points[C]//Proceedings of IEEE International Conference on Computer Vision. Cambridge:IEEE, 1995:882-887.
[11]	WOO D M, PARK D C. Stereo line matching based on the combination of geometric and intensity data[C]//Proceedings of the 24th International Symposium on Computer and Information Sciences. Guzelyurt:IEEE, 2009:581-585.
[12]	TIAN Yixiang, GERKE M, VOSSELMAN G, et al. Automatic edge matching across an image sequence based on reliable points[J]. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2008, 37:657-662.
[13]	FAN Bin, WU Fuchao, HU Zhanyi. Line matching leveraged by point correspondences[C]//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco:IEEE, 2010:390-397.
[14]	王志衡, 吴福朝. 均值-标准差描述子与直线匹配[J]. 模式识别与人工智能, 2009, 22(1):32-39. WANG Zhiheng, WU Fuchao. Mean-standard deviation descriptor and line matching[J]. Pattern Recognition and Artificial Intelligence, 2009, 22(1):32-39.
[15]	ZHANG Lilian, KOCH R. An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency[J]. Journal of Visual Communication and Image Representation, 2013, 24(7):794- 805.
[16]	VERHAGEN B, TIMOFTE R, VAN GOOL L. Scale-invariant line descriptors for wide baseline matching[C]//Proceedings of IEEE Winter Conference on Applications of Computer Vision. Steamboat Springs:IEEE, 2014:493-500.
[17]	梁艳, 盛业华, 张卡, 等. 利用局部仿射不变及核线约束的近景影像直线特征匹配[J]. 武汉大学学报(信息科学版), 2014, 39(2):229-233. LIANG Yan, SHENG Yehua, ZHANG Ka, et al. Linear feature matching method based on local affine invariant and Epipolar constraint for close-range images[J]. Geomatics and Information Science of Wuhan University, 2014, 39(2):229-233.
[18]	SCHMID C, ZISSERMAN A. The geometry and matching of lines and curves over multiple views[J]. International Journal of Computer Vision, 2000, 40(3):199-233.
[19]	SCHMID C, ZISSERMAN A. Automatic line matching across views[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Juan, Puerto Rico:IEEE, 1997:666-671.
[20]	王竞雪, 宋伟东, 王伟玺. 同名点及高程平面约束的航空影像直线匹配算法[J]. 测绘学报, 2016, 45(1):87-95. DOI:10.11947/j.AGCS.2016.20140527. WANG Jingxue, SONG Weidong, WANG Weixi. Line matching algorithm for aerial image based on corresponding points and Z-plane constraints[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(1):87-95. DOI:10.11947/j.AGCS.2016.20140527.
[21]	LI Kai, YAO Jian, LU Mengsheng, et al. Line segment matching:a benchmark[C]//Proceedings of 2016 IEEE Winter Conference on Applications of Computer Vision. Lake Placid:IEEE, 2016:1-9.
[22]	WANG Lu, NEUMANN U, YOU Suya. Wide-baseline image matching using line signatures[C]//Proceedings of the 12th IEEE International Conference on Computer Vision. Kyoto:IEEE, 2009:1311-1318.
[23]	LI Kai, YAO Jian, LU Xiaohu, et al. Hierarchical line matching based on line-junction-line structure descriptor and local homography estimation[J]. Neurocomputing, 2016, 184:207-220.
[24]	LI Kai, YAO Jian. Line segment matching and reconstruction via exploiting coplanar cues[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 125:33-49.
[25]	OK A Ö, WEGNER J D, HEIPKE C, et al. A new straight line reconstruction methodology from multi-spectral stereo aerial images[C]//Proceedings of ISPRS Technical Commission Ⅲ Symposium PCV 2010-Photogrammetric Computer Vision and Image Analysis. Saint-Mandé:International Society for Photogrammetry and Remote Sensing, 2010:25-30.
[26]	OK A O, WEGNER J D, HEIPKE C, et al. Matching of straight line segments from aerial stereo images of urban areas[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2012, 74:133-152.
[27]	王竞雪, 朱庆, 王伟玺. 顾及拓扑关系的立体影像直线特征可靠匹配算法[J]. 测绘学报, 2017, 46(1):1850-1858. DOI:10.11947/j.AGCS.2017.20170162. WANG Jingxue, ZHU Qing, WANG Weixi. Reliable line matching algorithm for stereo images with topological relationship[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(1):1850-1858. DOI:10.11947/j.AGCS.2017.20170162.
[28]	AL-SHAHRI M, YILMAZ A. Line matching in wide-baseline stereo:a top-down approach[J]. IEEE Transactions on Image Processing, 2014, 23(9):4119-4210.

联合共线约束与匹配冗余的组直线匹配结果检核算法

A checking algorithm for pair-wise line matching based on collinearity constraint and matching redundancy

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献 28

相关文章 7

编辑推荐

Metrics

本文评价

[1]	龚希, 谢忠, 周林, 何占军. 空间方向相似性二元组模型度量方法[J]. 测绘学报, 2021, 50(12): 1705-1716.
[2]	王竞雪, 朱庆, 王伟玺. 顾及拓扑关系的立体影像直线特征可靠匹配算法[J]. 测绘学报, 2017, 46(11): 1850-1858.
[3]	陈占龙, 龚希, 吴亮, 安晓亚. 顾及尺度差异的复合空间对象方向相似度定量计算模型[J]. 测绘学报, 2016, 45(3): 362-371.
[4]	王竞雪, 宋伟东, 王伟玺. 同名点及高程平面约束的航空影像直线匹配算法[J]. 测绘学报, 2016, 45(1): 87-95.
[5]	陈占龙, 周林, 龚希, 吴亮. 基于方向关系矩阵的空间方向相似性定量计算方法[J]. 测绘学报, 2015, 44(7): 813-821.
[6]	唐雪华秦昆孟令奎. 基于拓扑约束的方向关系定性描述模型[J]. 测绘学报, 2014, 43(4): 396-403.
[7]	李畅. 城市街道立面自动重建关键技术研究[J]. 测绘学报, 2011, 40(2): 268-268.