Line Matching Based on Discrete Description and Conjugate Point Constraint

doi:10.11947/j.AGCS.2018.20170231

Abstract

Abstract: Many unfavorable factors may hinder the line matching, such as fracture, deformation or occlusion occurred in line extraction. In order to overcome these problems, a novel method for line matching based on discrete description and conjugate point constraint is proposed. Firstly, the method employs the homography constraint together with epipolar constraint to determine candidate lines. Then, the initial line matching results are obtained by the distribution statistics of the conjugate points on the line. Finally, the mismatching in matched line pairs is eliminated by the similarity verification of line-point affine invariant. Extensive experiments on AMC580 aerial image set demonstrate the better performance of the proposed method as well as its superiority in curve matching and many-to-many matching. Compared with existing line matching methods, the proposed method can obtain more accurate line matching results under changes of image scale, brightness, occlusion, rotation, and achieves a performance of 90% higher matching correctness.

Key words: aerial image, line matching, discrete description, conjugate point constraint, curve matching

CLC Number:

P237

OUYANG Huan, FAN Dazhao, JI Song, LEI Rong. Line Matching Based on Discrete Description and Conjugate Point Constraint[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(10): 1363-1371.

References

[1] LOWE D G. Distinctive Image Features from Scale-invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[2] BAY H, TUYTELAARS T, VAN GOOL L. SURF:Speeded up Robust Features[M]//LEONARDIS A, BISCHOF H, PINZ A. Computer Vision. Berlin, Heidelberg:Springer, 2006.
[3] TOLA E, LEPETIT V, FUA P. DAISY:An Efficient Dense Descriptor Applied to Wide-baseline Stereo[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(5):815-830.
[4] RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB:An Efficient Alternative to SIFT or SURF[C]//Proceedings of 2011 IEEE International Conference on Computer Vision. Barcelona:IEEE, 2011:2564-2571.
[5] REVAUD J, WEINZAEPFEL P, HARCHAOUI Z, et al. Deep Matching:Hierarchical Deformable Dense Matching[J]. International Journal of Computer Vision, 2016, 120(3):300-323.
[6] WANG Zhiheng, WU Fuchao, HU Zhanyi. MSLD:A Robust Descriptor for Line Matching[J]. Pattern Recognition, 2009, 42(5):941-953.
[7] 黄良明, 彭立中, 程民德. 利用几何代数进行线段模型匹配和运动估计[J]. 中国图象图形学报, 2001, 6(3):270-274. HUANG Liangming, PENG Lizhong, CHENG Minde. Matching and Estimating Motion of Line Model Using Geometric Algebra[J]. Journal of Image and Graphics, 2001, 6(3):270-274.
[8] SUN Yanbiao, ZHAO Liang, HUANG Soudong, et al. Line Matching Based on Planar Homography for Stereo Aerial Images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015(104):1-17.
[9] BAILLARD C, SCHMID C, ZISSERMAN A, et al. Automatic Line Matching and 3D Reconstruction of Buildings from Multiple Views[C]//ISPRS Conference on Automatic Extraction of GIS Objects from Digital Imagery. Munich:International Archives of Photogrammetry and Remote Sensing, 1999:69-80.
[10] BAY H, FERRARI V, VAN GOOL L. Wide-baseline Stereo Matching with Line Segments[C]//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego:IEEE, 2005:329-336.
[11] 王竞雪, 宋伟东, 王伟玺. 同名点及高程平面约束的航空影像直线匹配算法[J]. 测绘学报, 2016, 45(1):87-95. DOI:10.11947//j.AGCS.2016.20140527. WANG Jingxue, SONG Weidong, WANG Weixi. Line Matching Algorithm for Aerial Image Based on Corresponding Points and Z-plane Constraints[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(1):87-95. DOI:10.11947//j.AGCS.2016.20140527.
[12] LI Kai, YAO Jian, LU Xiaohu, et al. Hierarchical Line Matching Based on Line-junction-line Structure Descriptor and Local Homography Estimation[J]. Neurocomputing, 2016, 184:207-220.
[13] JIA Qi, GAO Xinkai, FAN Xin, et al. Novel Coplanar Line-points Invariants for Robust Line Matching Across Views[C]//Proceedings of the 14th European Conference on Computer Vision. Amsterdam:Springer, 2016:599-611.
[14] FAN Bin, WU Fuchao, HU Zhanyi. Robust Line Matching Through Line-point Invariants[J]. Pattern Recognition, 2012, 45(2):794-805.
[15] RAMALINGAM S, ANTUNES M, SNOW D, et al. Line-sweep:Cross-ratio for Wide-baseline Matching and 3D Reconstruction[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Boston:IEEE, 2015:1238-1246.
[16] 张跃强, 苏昂, 朱遵尚, 等. 结合局部描述和拓扑约束的直线段匹配算法[J]. 国防科技大学学报, 2014, 36(6):25-30. ZHANG Yueqiang, SU Ang, ZHU Zunshang, et al. A Line Matching Algorithm Combining Local Description with Topological Constraint[J]. Journal of National University of Defense Technology, 2014, 36(6):25-30.
[17] KIM H, LEE S. Simultaneous Line Matching and Epipolar Geometry Estimation Based on the Intersection Context of Coplanar Line Pairs[J]. Pattern Recognition Letters, 2012, 33(10):1349-1363.
[18] ZHANG Li, GRUEN A. Multi-image Matching for DSM Generation from IKONOS Imagery[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2006, 60(3):195-211.
[19] 胡海霞. 视觉运动分析中的线特征提取与匹配方法研究[D]. 南昌:南昌航空大学, 2009:53-68. HU Haixia. Research on Extraction and Matching of Linear and Curvilinear Features in Vision Motion Analysis[D]. Nanchang:Nanchang Hangkong University, 2009:53-68.
[20] 张桂梅, 熊逸文, 马珂. 基于仿射不变性的轮廓曲线局部描述符[J]. 模式识别与人工智能, 2012, 25(6):972-978. ZHANG Guimei, XIONG Yiwen, MA Ke. Contour Curve Descriptor Based on Affine Invariance[J]. Pattern Recognition and Artificial Intelligence, 2012, 25(6):972-978.
[21] 王志衡, 智珊珊, 刘红敏. 基于亮度序的均值标准差描述子[J]. 模式识别与人工智能, 2013, 26(4):409-416. WANG Zhiheng, ZHI Shanshan, LIU Hongmin. Intensity Order Based Mean-standard Deviation Descriptor[J]. Pattern Recognition and Artificial Intelligence, 2013, 26(4):409-416.
[22] 彭科举. 基于序列图像的三维重建算法研究[D]. 长沙:国防科学技术大学, 2012:34-37. PENG Keju. 3D Reconstruction Using Image Sequences[D]. Changsha:National University of Defense Technology, 2012:34-37.
[23] 缪君, 储珺, 张桂梅. 一种仿射不变的直线描述子与直线匹配[J]. 电子学报, 2015, 43(12):2505-2512. MIAO Jun, CHU Jun, ZHANG Guimei. An Affine Invariant Line Descriptor and Line Matching[J]. Acta Electronica Sinica, 2015, 43(12):2505-2512.
[24] VON GIOI R G, JAKUBOWICZ J, MOREL J M, et al. LSD:A Line Segment Detector[J]. Image Processing on Line, 2012, 2(4):35-55.
[25] CANNY J. A Computational Approach to Edge Detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986, 8(6):679-698.