基于多视影像匹配模型的倾斜航空影像自动连接点提取及区域网平差方法

doi:10.11947/j.AGCS.2017.20160571

测绘学报 ›› 2017, Vol. 46 ›› Issue (5): 554-564.doi: 10.11947/j.AGCS.2017.20160571

基于多视影像匹配模型的倾斜航空影像自动连接点提取及区域网平差方法

张力¹, 艾海滨¹, 许彪¹, 孙钰珊^1,2, 董友强^1,3

1. 中国测绘科学研究院, 北京 100830;
2. 武汉大学测绘学院, 湖北武汉 430079;
3. 中国矿业大学(北京)地球科学与测绘工程学院, 北京 100083

收稿日期:2016-11-11 修回日期:2017-02-07 出版日期:2017-05-20 发布日期:2017-06-05
作者简介:张力(1970-),男,博士,研究员,博士生导师,研究方向为摄影测量与遥感。E-mail:zhangl@casm.ac.cn
基金资助:
国家自然科学基金（41271374）

Automatic Tie-point Extraction Based on Multiple-image Matching and Bundle Adjustment of Large Block of Oblique Aerial Images

ZHANG Li¹, AI Haibin¹, XU Biao¹, SUN Yushan^1,2, DONG Youqiang^1,3

1. Chinese Academy of Surveying & Mapping, Beijing 100830, China;
2. School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China;
3. College of Geoscience and Surveying Engineering, China University of Mining and Technology, Beijing 100083, China

Received:2016-11-11 Revised:2017-02-07 Online:2017-05-20 Published:2017-06-05
Supported by:
The National Natural Science Foundation of China (No. 41271374)

摘要/Abstract

摘要： 自动可靠地获取精确且均匀分布的连接点并进行区域网平差解算，是使用倾斜航空影像进行高精度测绘、三维信息提取和三维城市模型构建等应用的前提。本文提出了一种实用化的大重叠率倾斜航空影像的全自动连接点匹配和联合区域网平差方法。一方面，针对倾斜航空影像因遮挡严重、尺度变化大和几何变形严重而引起的同名点匹配困难问题，充分利用POS数据和平均飞行高度等初始数据，同时顾及这些数据的误差，通过有效组合一种改进的ASIFT算法和基于窗口的多角度多视影像匹配模型（WMVM），使用由粗到细的多分辨率分层匹配策略完成连接点的全自动提取；另一方面，在传统的最小二乘光束法平差的基础上，根据倾斜航空影像数据的特点，提出了基于稳健估值原理的粗差自动探测与剔除关键算法。最后，利用多组典型试验区域的倾斜航空影像数据试验结果验证了所提算法的可靠性、精度和实际性能。

关键词: 倾斜航空摄影, 光束法最小二乘平差, 仿射不变性特征提取算子, 特征提取, 多视影像匹配

Abstract: Due to advantages such as ease of interpretation, completeness through mitigation of occluding areas, as well as system accessibility, the aerial oblique images have found their place in numerous civil applications. However, for these applications high quality orientation data are essential. A fully automatic tie-point extraction procedure is developed to precisely orient the large block of oblique aerial images, in which a refined ASIFT algorithm and a window-based multiple-viewing image matching (WMVM) method are combined. In this approach, the WMVM method is based on the concept of multi-image matching guided from object space and allows reconstruction of 3D objects by matching all available images simultaneously, and a square correlation window in the reference image can be correlated with windows of different size, shape and orientation in the search images.Then another key algorithms, i.e. the combined bundle adjustment method with gross-error detection & removal algorithm, which can be used for simultaneously orient the oblique and nearly-vertical images will be presented. Finally, through the experiments by using real oblique images over several test areas, the performance and accuracy of the proposed method is studied and presented.

Key words: oblique aerial photos, bundle adjustment, affine invariant feature detector, feature extraction, multiple-image matching

中图分类号:

P237

张力, 艾海滨, 许彪, 孙钰珊, 董友强. 基于多视影像匹配模型的倾斜航空影像自动连接点提取及区域网平差方法[J]. 测绘学报, 2017, 46(5): 554-564.

ZHANG Li, AI Haibin, XU Biao, SUN Yushan, DONG Youqiang. Automatic Tie-point Extraction Based on Multiple-image Matching and Bundle Adjustment of Large Block of Oblique Aerial Images[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(5): 554-564.

参考文献

[1] 王伟, 黄雯雯, 镇姣. Pictometry倾斜摄影技术及其在3维城市建模中的应用[J]. 测绘与空间地理信息, 2011, 34(3):181-183. WANG Wei, HUANG Wenwen, ZHEN Jiao. Pictometry Oblique Photography Technique and Its Application in 3D City Modeling[J]. Geomatics & Spatial Information Technology, 2011, 34(3):181-183.
[2] 杨久勇, 高峰, 向宇. 倾斜航空摄影的原理与特点[C]//中国测绘学会2010年学术年会论文集. 南京:中国测绘学会, 2010:341-344. YANG Jiuyong, GAO Feng, XIANG Yu. Principle & Characteristics of the Oblique Aerial Photogrammetry[C]//Proceedings of the Society of Geodesy、Photogrammetry and Cartography. Nanjing:China Surveying and Mapping Society, 2010:341-344.
[3] 田野, 向宇, 高峰, 等. 利用Pictometry倾斜摄影技术进行全自动快速三维实景城市生产——以常州市三维实景城市生产为例[J]. 测绘通报, 2013(2):59-62,66. TIAN Ye, XIANG Yu, GAO Feng, et al. Automatic and Fast 3D True City Production Based on Pictometry Oblique Photogrammetry Technology[J]. Bulletin of Surveying and Mapping, 2013(2):59-62,66.
[4] 桂德竹, 林宗坚, 张成成. 倾斜航空影像的城市建筑物三维模型构建研究[J]. 测绘科学, 2012, 37(4):140-142. GUI Dezhu, LIN Zongjian, ZHANG Chengcheng. Research on Construction of 3D Building Based on Oblique Images from UAV[J]. Science of Surveying and Mapping, 2012, 37(4):140-142.
[5] WEITH-GLUSHKO S, SALVAGGIO C. Automatic Tie-point Generation for Oblique Aerial Imagery:An Algorithm[EB/OL].[2012-03-10]. http://testcis.cis.rit.edu/cnspci/references/theses/senior/weith-glushko2004.pdf.
[6] RUPNIK E, NEX F, REMONDINO F. Automatic Orientation of Large Blocks of Oblique Images[C]//International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences:XL-1/W1. Hannover:ISPRS, 2013:299-304.
[7] 姚国标, 邓喀中, 张力, 等. 融合互补仿射不变特征的倾斜立体影像高精度自动配准方法[J]. 测绘学报, 2013, 42(6):869-876. YAO Guobiao, DENG Kazhong, ZHANG Li, et al. An Automated Registration Method with High Accuracy for Oblique Stereo Images Based on Complementary Affine Invariant Features[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(6):869-876.
[8] WIEDEMANN A, MORé J. Orientation Strategies for Aerial Oblique Images[C]//International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences:XXXIX-B1. Melbourne:ISPRS, 2012:185-189.
[9] 闫利, 费亮, 叶志云, 等. 大范围倾斜多视影像连接点自动提取的区域网平差法[J]. 测绘学报, 2016, 45(3):310-317. DOI:10.11947/j.AGCS.2016.20140673. YAN Li, FEI Liang, YE Zhiyun, et al. Automatic Tie-points Extraction for Triangulation of Large-scale Oblique Multi-view Images[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(3):310-317. DOI:10.11947/j.AGCS.2016.20140673.
[10] 戴激光, 王新亮, 郭一洋. 一种稳健的倾斜航空影像粗差探测方法[J]. 测绘通报, 2014(5):28-31. DOI:10.13474/j.cnki.11-2246.2014.0151. DAI Jiguang, WANG Xinliang, GUO Yiyang. A Robust Method of Gross Error Detection for Oblique Aerial Image[J]. Bulletin of Surveying and Mapping, 2014(5):28-31. DOI:10.13474/j.cnki.11-2246.2014.0151.
[11] NISTÉR D. An Efficient Solution to the Five-point Relative Pose Problem[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(6):756-770.
[12] LÄBE T,FÖRSTNER W. Automatic Relative Orientation of Images[C]//Proceedings of the 5th Turkish-German Joint Geodetic Days. Berlin:[s.n.], 2006.
[13] LOWE D G. Distinctive Image Features from Scale-invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[14] MATAS J, CHUM O, URBAN M, et al. Robust Wide-baseline Stereo from Maximally Stable Extremal Regions[J]. Image and Vision Computing, 2004, 22(10):761-767.
[15] MIKOLAJCZYK K,SCHMID C. Scale & Affine Invariant Interest Point Detectors[J]. International Journal of Computer Vision, 2004, 60(1):63-86.
[16] YANG Huachao,ZHANG Shubi,WANG Yangbo. Robust and Precise Registration of Oblique Images Based on Scale-invariant Feature Transformation Algorithm[J]. IEEE Geoscience and Remote Sensing Letters, 2012, 9(4):783-787.
[17] YU Yinan, HUANG Kaiqi, CHEN Wei, et al. A Novel Algorithm for View and Illumination Invariant Image Matching[J]. IEEE Transactions on Image Processing, 2012, 21(1):229-240.
[18] MOREL J M, YU Guoshen. ASIFT:A New Framework for Fully Affine Invariant Image Comparison[J]. SIAM Journal on Imaging Sciences, 2009, 2(2):438-469.
[19] ZHANG Li. Automatic Digital Surface Model (DSM) Generation from Linear Array Images[D]. Zurich:Institute of Geodesy and Photogrammetry, ETH Zurich, 2005.
[20] ZHANG Li, GRUEN A. Multi-image Matching for DSM Generation from IKONOS Imagery[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2006, 60(3):195-211.
[21] 李德仁, 袁修孝. 误差处理与可靠性理论[M]. 武汉:武汉大学出版社, 2002. LI Deren, YUAN Xiuxiao. Error Processing and Reliability Theory[M]. Wuhan:Wuhan University Press, 2002.

基于多视影像匹配模型的倾斜航空影像自动连接点提取及区域网平差方法

Automatic Tie-point Extraction Based on Multiple-image Matching and Bundle Adjustment of Large Block of Oblique Aerial Images

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	金飞, 官恺, 刘智, 韩佳容, 芮杰, 李庆高. 无监督密集匹配特征提取网络性能分析[J]. 测绘学报, 2022, 51(3): 426-436.
[2]	杨必胜, 韩旭, 董震. 适用于城市场景大规模点云语义标识的深度学习网络[J]. 测绘学报, 2021, 50(8): 1059-1067.
[3]	李帅鑫, 李九人, 田滨, 陈龙, 王力, 李广云. 面向点云退化的隧道环境的无人车激光SLAM方法[J]. 测绘学报, 2021, 50(11): 1487-1499.
[4]	孙喜亮, 关宏灿, 苏艳军, 徐光彩, 郭庆华. 面向高精度城市测绘的激光紧耦合SLAM方法[J]. 测绘学报, 2021, 50(11): 1585-1593.
[5]	李永强, 李鹏鹏, 董亚涵, 范辉龙. 车载LiDAR点云数据中杆状地物自动提取与分类[J]. 测绘学报, 2020, 49(6): 724-735.
[6]	张瑞辰, 边少锋, 刘雁春, 李厚朴. 大面积水深异常检测的条件变化自编码算法[J]. 测绘学报, 2019, 48(9): 1182-1189.
[7]	余岸竹, 刘冰, 邢志鹏, 杨帆, 杨其淼. 面向高光谱影像分类的显著性特征提取方法[J]. 测绘学报, 2019, 48(8): 985-995.
[8]	陈晓勇, 何海清, 周俊超, 安谱阳, 陈婷. 低空摄影测量立体影像匹配的现状与展望[J]. 测绘学报, 2019, 48(12): 1595-1603.
[9]	邸凯昌, 万文辉, 赵红颖, 刘召芹, 王润之, 张飞舟. 视觉SLAM技术的进展与应用[J]. 测绘学报, 2018, 47(6): 770-779.
[10]	陈驰, 杨必胜, 田茂, 李健平, 邹响红, 吴唯同, 宋易恒. 车载MMS激光点云与序列全景影像自动配准方法[J]. 测绘学报, 2018, 47(2): 215-224.
[11]	李明磊, 刘少创, 杨欢, 亓晨. 双层优化的激光雷达点云场景分割方法[J]. 测绘学报, 2018, 47(2): 269-274.
[12]	赵泉华, 郭世波, 李晓丽, 李玉. 利用目标分解特征的全极化SAR海冰分类[J]. 测绘学报, 2018, 47(12): 1609-1620.
[13]	侯榜焕, 王锟, 姚敏立, 贾维敏, 王榕. 面向高光谱图像分类的半监督空谱判别分析[J]. 测绘学报, 2017, 46(9): 1098-1106.
[14]	陈振炜, 张过, 宁津生, 唐新明. 资源三号测绘卫星自动云检测[J]. 测绘学报, 2015, 44(3): 292-300.
[15]	郭宝云, 李彩林, 黄荣永. 附约束条件的零件轮廓线的多特征提取[J]. 测绘学报, 2015, 44(1): 46-51.