利用网络图进行高分辨率航空多视影像密集匹配

闫利; 费亮; 陈长海; 叶志云; 朱睿希

doi:10.11947/j.AGCS.2016.20160068

测绘学报 >

2016 , Vol. 45 >Issue 10: 1171 - 1181

DOI: https://doi.org/10.11947/j.AGCS.2016.20160068

摄影测量学与遥感

利用网络图进行高分辨率航空多视影像密集匹配

闫利 ,
费亮 ,
陈长海 ,
叶志云 ,
朱睿希

展开

武汉大学测绘学院, 湖北武汉 430079

闫利(1966-),男,博士,教授,研究方向为摄影测量与遥感。E-mail:lyan@sgg.whu.edu.cn.

收稿日期: 2016-02-24

修回日期: 2016-06-21

网络出版日期: 2016-11-08

基金资助

测绘地理信息公益性行业科研专项（201512008）；中央高校基本科研业务费专项资金（2015214020201）

收起

A Multi-view Dense Matching Algorithm of High Resolution Aerial Images Based on Graph Network

YAN Li ,
FEI Liang ,
CHEN Changhai ,
YE Zhiyun ,
ZHU Ruixi

Expand

School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China

Received date: 2016-02-24

Revised date: 2016-06-21

Online published: 2016-11-08

Supported by

The National Public Welfare Foundation for Surveying, Mapping and Geoinformation Industry Research (No.201512008);The Fundamental Research Funds for the Central Universities (No.2015214020201)

Fold

摘要

提出了一种基于网络图的高分辨率航空多视影像密集匹配算法。首先利用影像间的重叠关系和方向确定候选立体像对并构建网络图；在立体像对密集匹配阶段，引入导向中值滤波采用由粗到精的改进半全局匹配（SGM）算法进行双向视差图生成；最后基于所有立体像对构建的网络图完成多视影像间的密集点云生成及融合。试验选取了ISPRS的Vaihingen航空影像和ISPRS/EuroSDR项目的苏黎世倾斜下视影像进行试验，结果表明：本文算法对高分辨率多视影像密集匹配是有效可行的，无论在匹配完整性、效率、精度上都能获取较好的结果，重建的密集点云平均反投影误差的中误差可以达到亚像素级精度，实际精度可以达到1.5倍GSD，并且在建筑物、植被、水体等视差不连续、弱纹理或重复纹理区域也取得了较好的匹配结果。

关键词： 高分辨率; 多视影像; 密集匹配; 半全局匹配; 网络图

本文引用格式

闫利 , 费亮 , 陈长海 , 叶志云 , 朱睿希 . 利用网络图进行高分辨率航空多视影像密集匹配[J]. 测绘学报, 2016 , 45(10) : 1171 -1181 . DOI: 10.11947/j.AGCS.2016.20160068

Abstract

A multi-view dense matching algorithm of high resolution aerial images based on graph network was presented. Overlap ratio and direction between adjacent images was used to find the candidate stereo pairs and build the graph network, then a Coarse-to-Fine strategy based on modified semi-global matching algorithm (SGM) was adapted to calculate the disparity map of stereo pairs. Finally, dense point cloud was generated and fused using a multi-triangulation method based on graph network. In the experiment part, the Vaihingen aerial image dataset and the oblique nadir image block of Zürich in ISPRS/EuroSDR project were used to test the algorithm above. Experiment results show that out method is effective for multi-view dense matching of high resolution aerial images in consideration of completeness, efficiency and precision, while the RMS of average reprojection error can reach subpixel level and the actual deviation is better than 1.5 GSD. Due to the introduction of guided median filter, regions of sharp discontinuities, weak textureness or repeat textureness like buildings, vegetation and water body can also be matched well.

Key words： high resolution; multi-view; dense matching; SGM; graph network

参考文献

[1] HIRSCHMULLER H. Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information[C]//Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05). San Diego, CA:IEEE, 2005, 2:807-814.
[2] HIRSCHMULLER H. Stereo Processing by Semiglobal Matching and Mutual Information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2):328-341.
[3] GEHRKE S, MORIN K, DOWNEY M, et al. Semi-Global Matching:An Alternative to LIDAR for DSM Generation[C]//Proceedings of the 2010 Canadian Geomatics Conference and Symposium of Commission I. Calgary, AB, Canada:[s.n.], 2010, 2:6.
[4] ROTHERMEL M, WENZEL K, FRITSCH D, et al. SURE:Photogrammetric Surface Reconstruction from Imagery[C]//Proceedings LC3D Workshop. Berlin:[s.n.], 2012:8.
[5] ZHANG Li. Automatic Digital Surface Model (DSM) Generation from Linear Array Images[D]. Mitteilungen:Swiss Federal Institute of Technology (ETH) Zürich, 2005.
[6] PIERROT-DESEILLIGNY M, PAPARODITIS N. A Multiresolution and Optimization-based Image Matching Approach:An Application to Surface Reconstruction from SPOT5-HRS Stereo Imagery[C]//IAPRS vol XXXVI-1/W41 in ISPRS Workshop On Topographic Mapping from Space (With Special Emphasis on Small Satellites). Ankara, Turquie:[s.n.], 2006.
[7] GOESELE M, SNAVELY N, CURLESS B, et al. Multi-View Stereo for Community Photo Collections[C]//Proceedings of the 11th International Conference on Computer Vision. Rio de Janeiro:IEEE, 2007:1-8.
[8] REMONDINO F, MENNA F. Image-Based Surface Measurement for Close-Range Heritage Documentation[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Beijing:[s.n.], 2008, 37:199-206.
[9] FURUKAWA Y, PONCE J. Accurate, Dense, and Robust Multiview Stereopsis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376.
[10] VU H H, LABATUT P, PONS J P, et al. High Accuracy and Visibility-Consistent Dense Multiview Stereo[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(5):889-901.
[11] TOLDO R, FANTINI F, GIONA L, et al. Accurate Multiview Stereo Reconstruction with Fast Visibility Integration and Tight Disparity Bounding[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Trento, Italy:[s.n.], 2013:243-249.
[12] HAALA N. The Landscape of Dense Image Matching Algorithms[M]//FRITSCH D. Proceedings of Photogrammetric Week 2013. Stuttgart:[s.n.], 2013.
[13] HIRSCHMÜLLER H. Semi-Global Matching-Motivation, Developments and Applications[C]//Photogrammetric Week 11. Stuttgart, Germany:[s.n.], 2011:173-184.
[14] REMONDINO F, SPERA M G, NOCERINO E, et al. State of the Art in High Density Image Matching[J]. The Photogrammetric Record, 2014, 29(146):144-166.
[15] DESEILLIGNY M P, CLERY I. Apero, An Open Source Bundle Adjusment Software for Automatic Calibration and Orientation of Set of Images[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Trento, Italy:[s.n.], 2011:269277.
[16] 杨化超, 姚国标, 王永波. 基于SIFT的宽基线立体影像密集匹配[J]. 测绘学报, 2011, 40(5):537-543. YANG Huachao, YAO Guobiao, Wang Yongbo. Dense Matching for Wide Base-line Stereo Images Based on SIFT[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(5):537-543.
[17] 王竞雪, 朱庆, 王伟玺. 多匹配基元集成的多视影像密集匹配方法[J]. 测绘学报, 2013, 42(5):691-698. WANG Jingxue, ZHU Qing, WANG Weixi. A Dense Matching Algorithm of Multi-View Image Based on the Integrated Multiple Matching Primitives[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(5):691-698.
[18] 吴军, 姚泽鑫, 程门门. 融合SIFT与SGM的倾斜航空影像密集匹配[J]. 遥感学报, 2015, 19(3):431-442. WU Jun, YAO Zexin, CHENG Menmen. Airborne Oblique Stereo Image Dense Matching by Integrating SIFT and SGM Algorithm[J]. Journal of Remote Sensing, 2015, 19(3):431-442.
[19] LOOP C, ZHANG Zhengyou. Computing Rectifying Homographies for Stereo Vision[C]//Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition. Fort Collins, CO:IEEE, 1999:1.
[20] POLLEFEYS M, KOCH R, VAN GOOL L. A Simple and Efficient Rectification Method for General Motion[C]//Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra:IEEE, 1999, 1:496-501.
[21] MONASSE P, MOREL J M, TANG Zhongwei. Three-Step Image Rectification[C]//BMVC 2010-British Machine Vision Conference. Aberystwyth, United Kingdom:BMVA Press, 2010:89.1-89.10.

Options

文章导航

模态框（Modal）标题

摘要

本文引用格式

Abstract

参考文献