面向城区宽基线立体像对视角变化的结构自适应特征点匹配

doi:10.11947/j.AGCS.2019.20180266

测绘学报 ›› 2019, Vol. 48 ›› Issue (9): 1129-1140.doi: 10.11947/j.AGCS.2019.20180266

面向城区宽基线立体像对视角变化的结构自适应特征点匹配

陈敏¹, 朱庆¹, 何海清², 严少华¹, 赵怡涛¹

1. 西南交通大学地球科学与环境工程学院, 四川成都 611756;
2. 东华理工大学测绘工程学院, 江西南昌 330013

收稿日期:2018-06-08 修回日期:2019-01-23 出版日期:2019-09-20 发布日期:2019-09-25
作者简介:陈敏(1986-),男,博士,副教授,研究方向为多源遥感影像处理与分析。
基金资助:
国家自然科学基金（41631174；41971411；41501492）；国家重点研发计划课题（2016YFB0502603；2016YFB0501403）；中央高校基本科研业务费专项资金（2682017CX084；2682016CY02）

Structureadaptive feature point matching for urban area wide-baseline images with viewpoint variation

CHEN Min¹, ZHU Qing¹, HE Haiqing², YAN Shaohua¹, ZHAO Yitao¹

1. Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu 611756, China;
2. School of Geomatics, East China University of Technology, Nanchang 330013, China

Received:2018-06-08 Revised:2019-01-23 Online:2019-09-20 Published:2019-09-25
Supported by:
The National Natural Science Foundation of China (Nos. 41631174;41971411;41501492);The National Key Research and Development Program of China (Nos. 2016YFB0502603;2016YFB0501403);The Fundamental Research Funds for the Central Universities (Nos. 2682017CX084;2682016CY02)

摘要/Abstract

摘要： 提出一种基于结构自适应特征的城区宽基线影像特征点匹配方法。首先，对影像提取点特征和直线特征，挖掘点特征与其邻域内直线特征之间的几何关系，构建结构自适应的特征区域和特征描述符，并通过双向匹配策略获得初始匹配结果。然后，基于初匹配结果估计影像基础矩阵，构建核线约束的结构自适应特征匹配算法进行二次匹配。最后，将已匹配特征作为控制基础设计匹配扩展算法，进一步增加匹配点数量。本文方法以特征点邻域几何结构为出发点，构建自适应的特征区域，能够在显著的影像视角变化下，为同名特征点提取影像内容一致的特征区域，进而获得相似的特征描述符。试验结果证明，与传统算法相比，本文方法在城区宽基线影像上能够同时获得更多的正确匹配特征和更高的匹配正确率。

关键词: 城区宽基线影像, 特征点匹配, 结构自适应特征区域, 视角变化, 匹配扩展

Abstract: A feature point matching method based on structureadaptive feature is proposed for urban area wide-baseline images. Firstly, interest points and straight lines are detected from images. Structure adaptive feature region and descriptor are constructed by exploring the geometric relationship between the interest point and the straight lines located in the local neighborhood of the point, and initial matching results are obtained by using bi-directional matching strategy. Secondly, the fundamental matrix is estimated from the initial matching results. An epipolar geometry constrained structure adaptive feature matching method is proposed to match those features have not been matched in the initial matching step. Finally, a matching expansion method is proposed based on the previous matching results to improve the matching performance.The proposed matching method can generate similar feature regions and descriptors for corresponding features under significant image viewpoint variation benefiting from the proposed structure adaptive feature region construction method. The experimental results demonstrate that the proposed method provides significant improvements in correct matches number and matching precision compared with other traditional matching methods for urban area wide-baseline images (e.g. unmanned aerial vehicle images and oblique images) with viewpoint change and occlusion.

Key words: urban area wide-baseline image, feature point matching, structure adaptive feature region, viewpoint variation, matching expansion

中图分类号:

P237

陈敏, 朱庆, 何海清, 严少华, 赵怡涛. 面向城区宽基线立体像对视角变化的结构自适应特征点匹配[J]. 测绘学报, 2019, 48(9): 1129-1140.

CHEN Min, ZHU Qing, HE Haiqing, YAN Shaohua, ZHAO Yitao. Structureadaptive feature point matching for urban area wide-baseline images with viewpoint variation[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(9): 1129-1140.

导出引用管理器 EndNote|Reference Manager|ProCite|BibTeX|RefWorks

链接本文: http://xb.chinasmp.com/CN/10.11947/j.AGCS.2019.20180266

http://xb.chinasmp.com/CN/Y2019/V48/I9/1129

参考文献

[1] 戴激光, 宋伟东, 贾永红, 等. 一种新的异源高分辨率光学卫星遥感影像自动匹配算法[J]. 测绘学报, 2013, 42(1):80-86. DAI Jiguang, SONG Weidong, JIA Yonghong, et al. A new automatically matching algorithm for multi-source high resolution optical satellite images[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(1):80-86.
[2] 叶沅鑫, 单杰, 彭剑威, 等. 利用局部自相似进行多光谱遥感图像自动配准[J]. 测绘学报, 2014, 43(3):268-275. DOI:10.13485/j.cnki.11-2089.2014.0039. YE Yuanxin, SHAN Jie, PENG Jianwei, et al. Automated multispectral remote sensing image registration using local self-similarity[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(3):268-275. DOI:10.13485/j.cnki.11-2089.2014.0039.
[3] 岳春宇, 江万寿. 几何约束和改进SIFT的SAR影像和光学影像自动配准方法[J]. 测绘学报, 2012, 41(4):570-576. YUE Chunyu, JIANG Wanshou. An automatic registration algorithm for SAR and optical images based on geometry constraint and improved SIFT[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(4):570-576.
[4] 陈敏, 朱庆, 朱军, 等. SAR影像与光学影像的高斯伽玛型边缘强度特征匹配法[J]. 测绘学报, 2016, 45(3):318-325. DOI:10.11947/j.AGCS.2016.20150084. CHEN Min, ZHU Qing, ZHU Jun, et al. Feature matching for SAR and optical images based on Gaussian-Gamma-shaped edge strength map[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(3):318-325. DOI:10.11947/j.AGCS.2016.20150084.
[5] 梁焕青, 谢意, 付四洲. 颜色不变量与AKAZE特征相结合的无人机影像匹配算法[J]. 测绘学报, 2017, 46(7):900-909. DOI:10.11947/j.AGCS.2017.20160436. LIANG Huanqing, XIE Yi, FU Sizhou. UAV image registration algorithm using color invariant and AKAZE feature[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(7):900-909. DOI:10.11947/j.AGCS.2017.20160436.
[6] ZITOVÁ B, FLUSSER J. Image registration methods:a survey[J]. Image and Vision Computing, 2003, 21(11):977-1000.
[7] XIONG Zhen, ZHANG Yun. A novel interest-point-matching algorithm for high-resolution satellite images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(12):4189-4200.
[8] GRUEN A. Development and status of image matching in photogrammetry[J]. The Photogrammetric Record, 2012, 27(137):36-57.
[9] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[10] BAY H, ESS A, TUYTELAARS T, et al. Speeded-up robust features (SURF)[J]. Computer Vision and Image Understanding, 2008, 110(3):346-359.
[11] TOLA E, LEPETIT V, FUA P. Daisy:an efficient dense descriptor applied to wide-baseline stereo[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(5):815-830.
[12] MOREL J M, YU Guoshen. ASIFT:a new framework for fully affine invariant image comparison[J]. SIAM Journal on Imaging Sciences, 2009, 2(2):438-469.
[13] HU Han, ZHU Qing, DU Zhiqiang, et al. Reliable spatial relationship constrained feature point matching of oblique aerial images[J]. Photogrammetric Engineering & Remote Sensing, 2015, 81(1):49-58.
[14] 肖雄武, 郭丙轩, 李德仁, 等. 一种具有仿射不变性的倾斜影像快速匹配方法[J]. 测绘学报, 2015, 44(4):414-421. DOI:10.11947/j.AGCS.2015.20140048. XIAO Xiongwu, GUO Bingxuan, LI Deren, et al. A quick and affine invariance matching method for oblique images[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(4):414-421. DOI:10.11947/j.AGCS.2015.20140048.
[15] 肖雄武, 李德仁, 郭丙轩, 等. 一种具有视点不变性的倾斜影像快速匹配方法[J]. 武汉大学学报(信息科学版), 2016, 41(9):1151-1159. XIAO Xiongwu, LI Deren, GUO Bingxuan, et al. A robust and rapid viewpoint-invariant matching method for oblique images[J]. Geomatics and Information Science of Wuhan University, 2016, 41(9):1151-1159.
[16] 闫利, 费亮, 叶志云, 等. 大范围倾斜多视影像连接点自动提取的区域网平差法[J]. 测绘学报, 2016, 45(3):310-317. DOI:10.11947/j.AGCS.2016.20140673. YAN Li, FEI Liang, YE Zhiyun, et al. Automatic tie-points extraction for triangulation of large-scale oblique multi-view images[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(3):310-317. DOI:10.11947/j.AGCS.2016.20140673.
[17] 张力, 艾海滨, 许彪, 等. 基于多视影像匹配模型的倾斜航空影像自动连接点提取及区域网平差方法[J]. 测绘学报, 2017, 46(5):554-564. DOI:10.11947/j.AGCS.2017.20160571. ZHANG Li, AI Haibin, XU Biao, et al. Automatic tie-point extraction based on multiple-image matching and bundle adjustment of large block of oblique aerial images[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(5):554-564. DOI:10.11947/j.AGCS.2017.20160571.
[18] SUN Yanbiao, ZHAO Liang, HUANG Shoudong, et al. L2-SIFT:SIFT feature extraction and matching for large images in large-scale aerial photogrammetry[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014(91):1-16.
[19] JIANG San, JIANG Wanshou. On-board GNSS/IMU assisted feature extraction and matching for oblique UAV images[J]. Remote Sensing, 2017, 9(8):813.
[20] YU Yinan, HUANG Kaiqi, CHEN Wei, et al. A novel algorithm for view and illumination invariant image matching[J]. IEEE Transactions on Image Processing, 2012, 21(1):229-240.
[21] 仇春平, 于瑞鹏, 丁翠, 等. 面向倾斜立体影像的尺度不变特征匹配[J]. 遥感信息, 2016, 31(1):43-47. QIU Chunping, YU Ruipeng, DING Cui, et al. Oblique stereo image matching based on scale invariant feature[J]. Remote Sensing Information, 2016, 31(1):43-47.
[22] FISCHLER M A, BOLLES R C. Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6):381-395.
[23] LI Kai, YAO Jian. Line segment matching and reconstruction via exploiting coplanar cues[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017(125):33-49.
[24] CHEN Min, QIN Rongjun, HE Haiqing, et al. A local distinctive features matching method for remote sensing images with repetitive patterns[J]. Photogrammetric Engineering & Remote Sensing, 2018, 84(8):513-524.
[25] MIKOLAJCZYK K, SCHMID C. Scale & affine invariant interest point detectors[J]. International Journal of Computer Vision, 2004, 60(1):63-86.
[26] MATAS J, CHUM O, URBAN M, et al. Robust wide-baseline stereo from maximally stable extremal regions[J]. Image and Vision Computing, 2004, 22(10):761-767.
[27] HARRIS C, STEPHENS M. A combined corner and edge detector[C]//Proceedings of the 4th Alvey Vision Conference. Manchester, Britain:[s.n.], 1988:147-152.
[28] VON GIOI R G, JAKUBOWICZ J, MOREL J M, et al. LSD:a fast line segment detector with a false detection control[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(4):722-732.
[29] WU Changchang. SiftGPU:a GPU implementation of scale invariant feature transform[EB/OL]. (2011). http://ccwu.me/code.html.
[30] YU Guoshen, MOREL J M. ASIFT:an algorithm for fully affine invariant comparison[J]. Image Processing On Line, 2011(1):11-38.

面向城区宽基线立体像对视角变化的结构自适应特征点匹配

Structureadaptive feature point matching for urban area wide-baseline images with viewpoint variation

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	李鹏, 张家涵, 汪志翰, 王厚杰, 李振洪. 潮间带地形重建方法综述：现状、挑战与趋势[J]. 测绘学报, 2026, 55(4): 571-587.
[2]	付波霖, 黄柯越, 杨艳丽, 孙伟伟, 王朝茵. 基于实测全谱段高光谱数据的多场景红树林土壤光谱响应特性解析及土壤有机碳含量反演[J]. 测绘学报, 2026, 55(4): 604-617.
[3]	吴岚昕, 彭江涛, 孙伟伟, 杨冰. 面向海岸带湿地高光谱遥感的欧拉映射与互补特征建模变化检测方法[J]. 测绘学报, 2026, 55(4): 618-631.
[4]	高二涛, 刘静, 李淑瑾, 周国清, 付波霖, 李淑娴. 光学遥感与SAR协同的茅尾海潮滩多维时空演变监测与分析[J]. 测绘学报, 2026, 55(4): 632-646.
[5]	徐豪, 徐南, 辛会超, 马跃, 涂伟, 李清泉. 基于ICESat-2卫星高度计数据的潮间带地形光子提取方法[J]. 测绘学报, 2026, 55(4): 658-672.
[6]	布金伟, 刘淑慧, 徐顺双, 向彤粟, 汪秋兰, 籍超颖, 左小清. 星载GNSS-R全球海浪波周期估计的经验模型构建[J]. 测绘学报, 2026, 55(4): 684-697.
[7]	杨泽鑫. 基于点云数据的建筑物多细节层次模型重建关键技术研究[J]. 测绘学报, 2026, 55(4): 755-755.
[8]	姚永祥. 基于广义相似性特征的多模态遥感影像稳健匹配[J]. 测绘学报, 2026, 55(4): 757-757.
[9]	续东. 基于多源三维底座数据的全局定位关键技术研究[J]. 测绘学报, 2026, 55(4): 760-760.
[10]	叶晨鸣, 康志忠, 才谨豪, 左秉正, 邵帅, 李彦. 形态特征引导的月表地理实体实景三维建模方法[J]. 测绘学报, 2026, 55(3): 525-535.
[11]	王美莲. 基于手持激光雷达点云的树种分类及枝叶分离研究[J]. 测绘学报, 2026, 55(3): 569-569.
[12]	彭代锋, 刘雪莲, 鲁梦飞, 管海燕. 基于多尺度跨模态特征融合的异源遥感影像洪水变化检测[J]. 测绘学报, 2026, 55(2): 328-343.
[13]	胡浩鹏, 吴杭彬, 战仕浩, 温在豪, 刘春. 视觉点云质量优化支持的道路杆状物变化检测[J]. 测绘学报, 2026, 55(2): 344-358.
[14]	余东行. 高分辨率遥感影像场景与目标识别技术研究[J]. 测绘学报, 2026, 55(2): 377-377.
[15]	韩斌, 黄欣, 李丰毅, 卢晓珍. 一种双编码器自适应特征融合的SAR图像水体分割网络[J]. 测绘学报, 2026, 55(1): 101-113.