Reliable Line Matching Algorithm for Stereo Images with Topological Relationship

doi:10.11947/j.AGCS.2017.20170162

Abstract

Abstract:

Because of the lack of relationships between matching line and adjacent lines in the process of individual line matching, and the weak reliability of the individual line descriptor facing on discontinue texture, this paper presents a reliable line matching algorithm for stereo images with topological relationship. The algorithm firstly generates grouped line pairs from lines extracted from the reference image and searching image according to the basic topological relationships such as distance and angle between the lines. Then it takes the grouped line pairs as matching primitives, and matches these grouped line pairs by using epipolar constraint, homography constraint, quadrant constraint and gray correlation constraint of irregular triangle in order. And finally, it resolves the corresponding line pairs into two pairs of corresponding individual lines, and obtains one to one matching results after the post-processing of integrating, fitting, and checking. This paper adopts digital aerial images and close-range images with typical texture features to deal with the parameter analysis and line matching, and the experiment results demonstrate that the proposed algorithm in this paper can obtain reliable line matching results.

Key words: line matching, pair-wise line matching, topological relations, epipolar constraint, homography

CLC Number:

P237

WANG Jingxue, ZHU Qing, WANG Weixi. Reliable Line Matching Algorithm for Stereo Images with Topological Relationship[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(11): 1850-1858.

References

[1] ZHANG Li.Automatic Digital Surface Model(DSM)Generation from Linear Array Images[D].Zurich:Institute of Geodesy and Photogrammetry,2005.
[2] 江万寿.航空影像多视匹配与规则建筑物自动提取方法研究[D].武汉:武汉大学,2004. JIANG Wanshou.Multiple Aerial Image Matching and Automatic Building Detection[D].Wuhan:Wuhan University,2004.
[3] 文贡坚.一种基于特征编组的直线立体匹配全局算法[J].软件学报,2006,17(12):2471-2484. WEN Gongjian.A Global Algorithm for Straight Line Stereo Matching Based on Feature Grouping[J].Journal of Software,2006,17(12):2471-2484.
[4] ZHANG Lilian,KOCH R.An Efficient and Robust Line Segment Matching Approach Based on LBD Descriptor and Pairwise Geometric Consistency[J].Journal of Visual Communication and Image Representation,2013,24(7):794-805.
[5] 席学强,王润生.基于直线特征的图像-模型匹配算法[J].国防科技大学学报,2000,22(6):70-74. XI Xueqiang,WANG Runsheng.An Algorithm of Image-model Matching Based on Straight Line Features[J].Journal of National University of Defense Technology,2000,22(6):70-74.
[6] SCHMID C,ZISSERMAN A.Automatic Line Matching Across Views[C]//Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition.San Juan,Puerto Rico:IEEE,1997:666-671.
[7] 张云生,朱庆,吴波,等.一种基于三角网约束的立体影像线特征多级匹配方法[J].武汉大学学报(信息科学版),2013,38(5):522-527. ZHANG Yunsheng,ZHU Qing,WU Bo,et al.A Hierarchical Stereo Line Matching Method Based on a Triangle Constraint[J].Geomatics and Information Science of Wuhan University,2013,38(5):522-527.
[8] WU Bo,ZHANG Yunsheng,ZHU Qing.Integrated Point and Edge Matching on Poor Textural Images Constrained by Self-adaptive Triangulations[J].ISPRS Journal of Photogrammetry and Remote Sensing,2012,68(1):40-55.
[9] 梁艳,盛业华,张卡,等.利用局部仿射不变及核线约束的近景影像直线特征匹配[J].武汉大学学报(信息科学版),2014,39(2):229-233. LIANG Yan,SHENG Yehua,ZHANG Ka,et al.Linear Feature Matching Method Based on Local Affine Invariant and Epipolar Constraint for Close-range Images[J].Geomatics and Information Science of Wuhan University,2014,39(2):229-233.
[10] 王竞雪,宋伟东,王伟玺.同名点及高程平面约束的航空影像直线匹配算法[J].测绘学报,2016,45(1):87-95.DOI:10.11947/j.AGCS.2016.20140527. WANG Jingxue,SONG Weidong,WANG Weixi.Line Matching Algorithm for Aerial Image Based on Corresponding Points and Z-plane Constraints[J].Acta Geodaetica et Cartographica Sinica,2016,45(1):87-95.DOI:10.11947/j.AGCS.2016.20140527.
[11] FAN Bin,WU Fuchao,HU Zhanyi.Line Matching Leveraged By Point Correspondences[C]//Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition.San Francisco:IEEE,2010:390-397.
[12] 王志衡,吴福朝.均值-标准差描述子与直线匹配[J].模式识别与人工智能,2009,22(1):32-39. WANG Zhiheng,WU Fuchao.Mean-standard Deviation Descriptor and Line Matching[J].Pattern Recognition and Artificial Intelligence,2009,22(1):32-39.
[13] WANG Zhiheng,WU Fuchao,HU Zhanyi.MSLD:A Robust Descriptor for Line Matching[J].Pattern Recognition,2009,42(5):941-953.
[14] AL-SHAHRI M,YILMAZ A.Line Matching in Wide-Baseline Stereo:A Top-down Approach[J].IEEE Transactions on Image Processing,2014,23(9):4199-4210.
[15] WANG Jingxue,WANG Weixi,LI Xiaoming,et al.Line Matching Algorithm for Aerial Image Combining Image and Object Space Similarity Constraints[C]//International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences:XLI-B3.Prague,Czech Republic:ISPRS,2016:783-788.
[16] 缪君,储珺,张桂梅.一种仿射不变的直线描述子与直线匹配[J].电子学报,2015,43(12):2505-2512. MIAO Jun,CHU Jun,ZHANG Guimei.An Affine Invariant Line Descriptor and Line Matching[J].Acta Electronica Sinica,2015,43(12):2505-2512.
[17] 宋伟东,朱红,王竞雪,等.多重约束下的近景影像线特征匹配方法[J].中国图象图形学报,2016,21(6):764-770. SONG Weidong,ZHU Hong,WANG Jingxue,et al.Line Feature Matching Method based on Multiple Constraints for Close-range Images[J].Journal of Image and Graphics,2016,21(6):764-770.
[18] 张跃强,苏昂,朱遵尚,等.结合局部描述和拓扑约束的直线段匹配算法[J].国防科技大学学报,2014,36(6):25-30. ZHANG Yueqiang,SU Ang,ZHU Zunshang,et al.A Line Matching Algorithm Combining Local Description with Topological Constraint[J].Journal of National University of Defense Technology,2014,36(6):25-30.
[19] 高峰,文贡坚,吕金建.基于干线对的红外与可见光最优图像配准算法[J].计算机学报,2007,30(6):1014-1021. GAO Feng,WEN Gongjian,LV Jinjian.An Optimal Algorithm for IR/Visual Image Registration Based on Main-line-pairs[J].Chinese Journal of Computers,2007,30(6):1014-1021.
[20] 张浩,才辉,张光新,等.一种新的基于边缘拟合的图像配准方法[J].光电子·激光,2009,20(1):103-107. ZHANG Hao,CAI Hui,ZHANG Guangxin,et al.A Novel Image Registration Method Based on Edge Fitting[J].Journal of Optoelectronics·Laser,2009,20(1):103-107.
[21] OK A O,WEGNER J D,HEIPKE C,et al.Matching of Straight Line Segments from Aerial Stereo Images of Urban Areas[J].ISPRS Journal of Photogrammetry and Remote Sensing,2012,74(1):133-152.
[22] OK A Ö,WEGNER J D,HEIPKE C,et al.A Stereo Line Matching Technique for Aerial Images Based on a Pair-wise Relation Approach[C]//Proceedings of the Istanbul Workshop 2010 on Modeling of Optical Airborne and Space borne Sensors:XXXVⅢ-1/W17.Istanbul,Turkey:ISPRS,2010.
[23] OK A Ö,WEGNER J D,HEIPKE C,et al.A New Straight Line Reconstruction Methodology from Multi-spectral Stereo Aerial Images[C]//PAPARODITIS N,PIERROT-DESEILLIGNY M,MALLET C,et al.IAPRS,Vol.XXXVⅢ.Saint-Mandé,France:ISPRS,2010:25-30.
[24] KIM H,LEE S.Simultaneous Line Matching And Epipolar Geometry Estimation Based on the Intersection Context of Coplanar Line Pairs[J].Pattern Recognition Letters,2012,33(10):1349-1363.
[25] VON DIOI R G,JAKUBOWICZ J,MOREL J M,et al.LSD:A Fast Line Segment Detector with a False Detection Control[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(4):722-732.