A checking algorithm for pair-wise line matching based on collinearity constraint and matching redundancy

doi:10.11947/j.AGCS.2020.20190123

Abstract

Abstract: A checking algorithm for pair-wise line matching is proposed to solve the problems of one-to-many, many-to-one and many-to-many in line segment matching by combining collinearity constraint and matching redundancy. The proposed method is performed on pair-wise line matches generated from existing method. Firstly, individual line segment matches are obtained based on pair-wise line matches. A relation matrix is constructed for pair-wise line matches and individual line segment matches, respectively. In each relation matrix, row and column numbers correspond to the indexes of matching primitives on the reference and searching images respectively. Each matrix element can be used to record the number of matches, feature similarity or some other multi-source information corresponding to the current row and column. Secondly, the corresponding relation of one-to-many, many-to-one and many-to-many matches is established on the basis of local relation matrix which is extracted from the aforementioned relation matrix. Then, the local relation matrix is combined with collinearity constraint, matching redundancy and feature similarity to identify and eliminate outliers in the matching results. Finally, the breaking lines in the results are fitted to produce one-to-one line segment correspondences. The proposed algorithm is evaluated on digital aerial images and close-images with typical texture features. The experimental results demonstrate the effectiveness of the proposed algorithm in pair-wise line matching result checking.

Key words: line matching, pair-wise line matching, results checking, matching redundancy, relation matrix

CLC Number:

P237

WANG Jingxue, LIU Suyan, WANG Weixi. A checking algorithm for pair-wise line matching based on collinearity constraint and matching redundancy[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(6): 746-756.

References 28

[1]	李畅, 刘亚文, 胡敏, 等. 面向街景立面三维重建的近景影像直线匹配方法研究[J]. 武汉大学学报(信息科学版), 2010, 35(12):1461-1465. LI Chang, LIU Yawen, HU Min, et al. Study on street elevation 3D reconstruction-oriented straight line matching for close-range images[J]. Geomatics and Information Science of Wuhan University, 2010, 35(12):1461-1465.
[2]	ZHANG Yongjun, ZHANG Zuxun, ZHANG Jianqing, et al. 3D building modelling with digital map, LiDAR data and video image sequences[J]. The Photogrammetric Record, 2005, 20(111):285-302.
[3]	高新凯. 基于几何不变量的直线匹配与三维建模[D]. 大连:大连理工大学, 2017. GAO Xinkai. Line matching and 3D modeling using geometric invariants[D]. Dalian:Dalian University of Technology, 2017.
[4]	邓刘洋, 沈占锋, 柯映明. 城市建成区遥感影像边界提取与扩张分析[J]. 地球信息科学学报, 2018, 20(7):996-1003. DENG Liuyang, SHEN Zhanfeng, KE Yingming. Built-up area extraction and urban expansion analysis based on remote sensing images[J]. Journal of Geo-Information Science, 2018, 20(7):996-1003.
[5]	黄良明, 彭立中, 程民德. 利用几何代数进行线段模型匹配和运动估计[J]. 中国图象图形学报, 2001, 6(3):270-274. HUANG Liangming, PENG Lizhong, CHENG Minde. Matching and estimating motion of line model using geometric algebra[J]. Journal of Image and Graphics, 2001, 6(3):270-274.
[6]	邵振峰, 陈敏. 尺度、旋转以及亮度稳健的高分辨率影像直线特征匹配[J]. 光学精密工程, 2013, 21(3):790-798. SHAO Zhenfeng, CHEN Min. Line-based matching for high-resolution images with robustness for scale, rotation and illumination[J]. Optics and Precision Engineering, 2013, 21(3):790-798.
[7]	张云生, 朱庆, 吴波, 等. 一种基于三角网约束的立体影像线特征多级匹配方法[J]. 武汉大学学报(信息科学版), 2013, 38(5):522-527. ZHANG Yunsheng, ZHU Qing, WU Bo, et al. A hierarchical stereo line matching method based on a triangle constraint[J]. Geomatics and Information Science of Wuhan University, 2013, 38(5):522-527.
[8]	张云生. 自适应三角形约束的多基元多视影像匹配方法[D]. 武汉:武汉大学, 2011. ZHANG Yunsheng. A multi-primitive and multi-view image matching method based on self-adaptive triangle constraint[D]. Wuhan:Wuhan University, 2011.
[9]	刘亚文. 基于TIN的半自动多影像同名线段匹配算法研究[J]. 武汉大学学报(信息科学版), 2004, 29(4):342-345. LIU Yawen. A semi-automatic algorithm for line matching based on delaunay triangulation[J]. Geomatics and Information Science of Wuhan University, 2004, 29(4):342-345.
[10]	HARTLEY R I. A linear method for reconstruction from lines and points[C]//Proceedings of IEEE International Conference on Computer Vision. Cambridge:IEEE, 1995:882-887.
[11]	WOO D M, PARK D C. Stereo line matching based on the combination of geometric and intensity data[C]//Proceedings of the 24th International Symposium on Computer and Information Sciences. Guzelyurt:IEEE, 2009:581-585.
[12]	TIAN Yixiang, GERKE M, VOSSELMAN G, et al. Automatic edge matching across an image sequence based on reliable points[J]. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2008, 37:657-662.
[13]	FAN Bin, WU Fuchao, HU Zhanyi. Line matching leveraged by point correspondences[C]//Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco:IEEE, 2010:390-397.
[14]	王志衡, 吴福朝. 均值-标准差描述子与直线匹配[J]. 模式识别与人工智能, 2009, 22(1):32-39. WANG Zhiheng, WU Fuchao. Mean-standard deviation descriptor and line matching[J]. Pattern Recognition and Artificial Intelligence, 2009, 22(1):32-39.
[15]	ZHANG Lilian, KOCH R. An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency[J]. Journal of Visual Communication and Image Representation, 2013, 24(7):794- 805.
[16]	VERHAGEN B, TIMOFTE R, VAN GOOL L. Scale-invariant line descriptors for wide baseline matching[C]//Proceedings of IEEE Winter Conference on Applications of Computer Vision. Steamboat Springs:IEEE, 2014:493-500.
[17]	梁艳, 盛业华, 张卡, 等. 利用局部仿射不变及核线约束的近景影像直线特征匹配[J]. 武汉大学学报(信息科学版), 2014, 39(2):229-233. LIANG Yan, SHENG Yehua, ZHANG Ka, et al. Linear feature matching method based on local affine invariant and Epipolar constraint for close-range images[J]. Geomatics and Information Science of Wuhan University, 2014, 39(2):229-233.
[18]	SCHMID C, ZISSERMAN A. The geometry and matching of lines and curves over multiple views[J]. International Journal of Computer Vision, 2000, 40(3):199-233.
[19]	SCHMID C, ZISSERMAN A. Automatic line matching across views[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Juan, Puerto Rico:IEEE, 1997:666-671.
[20]	王竞雪, 宋伟东, 王伟玺. 同名点及高程平面约束的航空影像直线匹配算法[J]. 测绘学报, 2016, 45(1):87-95. DOI:10.11947/j.AGCS.2016.20140527. WANG Jingxue, SONG Weidong, WANG Weixi. Line matching algorithm for aerial image based on corresponding points and Z-plane constraints[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(1):87-95. DOI:10.11947/j.AGCS.2016.20140527.
[21]	LI Kai, YAO Jian, LU Mengsheng, et al. Line segment matching:a benchmark[C]//Proceedings of 2016 IEEE Winter Conference on Applications of Computer Vision. Lake Placid:IEEE, 2016:1-9.
[22]	WANG Lu, NEUMANN U, YOU Suya. Wide-baseline image matching using line signatures[C]//Proceedings of the 12th IEEE International Conference on Computer Vision. Kyoto:IEEE, 2009:1311-1318.
[23]	LI Kai, YAO Jian, LU Xiaohu, et al. Hierarchical line matching based on line-junction-line structure descriptor and local homography estimation[J]. Neurocomputing, 2016, 184:207-220.
[24]	LI Kai, YAO Jian. Line segment matching and reconstruction via exploiting coplanar cues[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 125:33-49.
[25]	OK A Ö, WEGNER J D, HEIPKE C, et al. A new straight line reconstruction methodology from multi-spectral stereo aerial images[C]//Proceedings of ISPRS Technical Commission Ⅲ Symposium PCV 2010-Photogrammetric Computer Vision and Image Analysis. Saint-Mandé:International Society for Photogrammetry and Remote Sensing, 2010:25-30.
[26]	OK A O, WEGNER J D, HEIPKE C, et al. Matching of straight line segments from aerial stereo images of urban areas[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2012, 74:133-152.
[27]	王竞雪, 朱庆, 王伟玺. 顾及拓扑关系的立体影像直线特征可靠匹配算法[J]. 测绘学报, 2017, 46(1):1850-1858. DOI:10.11947/j.AGCS.2017.20170162. WANG Jingxue, ZHU Qing, WANG Weixi. Reliable line matching algorithm for stereo images with topological relationship[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(1):1850-1858. DOI:10.11947/j.AGCS.2017.20170162.
[28]	AL-SHAHRI M, YILMAZ A. Line matching in wide-baseline stereo:a top-down approach[J]. IEEE Transactions on Image Processing, 2014, 23(9):4119-4210.