A Multi-view Dense Matching Algorithm of High Resolution Aerial Images Based on Graph Network

doi:10.11947/j.AGCS.2016.20160068

Abstract

Abstract:

A multi-view dense matching algorithm of high resolution aerial images based on graph network was presented. Overlap ratio and direction between adjacent images was used to find the candidate stereo pairs and build the graph network, then a Coarse-to-Fine strategy based on modified semi-global matching algorithm (SGM) was adapted to calculate the disparity map of stereo pairs. Finally, dense point cloud was generated and fused using a multi-triangulation method based on graph network. In the experiment part, the Vaihingen aerial image dataset and the oblique nadir image block of Zürich in ISPRS/EuroSDR project were used to test the algorithm above. Experiment results show that out method is effective for multi-view dense matching of high resolution aerial images in consideration of completeness, efficiency and precision, while the RMS of average reprojection error can reach subpixel level and the actual deviation is better than 1.5 GSD. Due to the introduction of guided median filter, regions of sharp discontinuities, weak textureness or repeat textureness like buildings, vegetation and water body can also be matched well.

Key words: high resolution, multi-view, dense matching, SGM, graph network

CLC Number:

P237.3

YAN Li, FEI Liang, CHEN Changhai, YE Zhiyun, ZHU Ruixi. A Multi-view Dense Matching Algorithm of High Resolution Aerial Images Based on Graph Network[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(10): 1171-1181.

References

[1] HIRSCHMULLER H. Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information[C]//Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05). San Diego, CA:IEEE, 2005, 2:807-814.
[2] HIRSCHMULLER H. Stereo Processing by Semiglobal Matching and Mutual Information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2):328-341.
[3] GEHRKE S, MORIN K, DOWNEY M, et al. Semi-Global Matching:An Alternative to LIDAR for DSM Generation[C]//Proceedings of the 2010 Canadian Geomatics Conference and Symposium of Commission I. Calgary, AB, Canada:[s.n.], 2010, 2:6.
[4] ROTHERMEL M, WENZEL K, FRITSCH D, et al. SURE:Photogrammetric Surface Reconstruction from Imagery[C]//Proceedings LC3D Workshop. Berlin:[s.n.], 2012:8.
[5] ZHANG Li. Automatic Digital Surface Model (DSM) Generation from Linear Array Images[D]. Mitteilungen:Swiss Federal Institute of Technology (ETH) Zürich, 2005.
[6] PIERROT-DESEILLIGNY M, PAPARODITIS N. A Multiresolution and Optimization-based Image Matching Approach:An Application to Surface Reconstruction from SPOT5-HRS Stereo Imagery[C]//IAPRS vol XXXVI-1/W41 in ISPRS Workshop On Topographic Mapping from Space (With Special Emphasis on Small Satellites). Ankara, Turquie:[s.n.], 2006.
[7] GOESELE M, SNAVELY N, CURLESS B, et al. Multi-View Stereo for Community Photo Collections[C]//Proceedings of the 11th International Conference on Computer Vision. Rio de Janeiro:IEEE, 2007:1-8.
[8] REMONDINO F, MENNA F. Image-Based Surface Measurement for Close-Range Heritage Documentation[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Beijing:[s.n.], 2008, 37:199-206.
[9] FURUKAWA Y, PONCE J. Accurate, Dense, and Robust Multiview Stereopsis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376.
[10] VU H H, LABATUT P, PONS J P, et al. High Accuracy and Visibility-Consistent Dense Multiview Stereo[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(5):889-901.
[11] TOLDO R, FANTINI F, GIONA L, et al. Accurate Multiview Stereo Reconstruction with Fast Visibility Integration and Tight Disparity Bounding[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Trento, Italy:[s.n.], 2013:243-249.
[12] HAALA N. The Landscape of Dense Image Matching Algorithms[M]//FRITSCH D. Proceedings of Photogrammetric Week 2013. Stuttgart:[s.n.], 2013.
[13] HIRSCHMÜLLER H. Semi-Global Matching-Motivation, Developments and Applications[C]//Photogrammetric Week 11. Stuttgart, Germany:[s.n.], 2011:173-184.
[14] REMONDINO F, SPERA M G, NOCERINO E, et al. State of the Art in High Density Image Matching[J]. The Photogrammetric Record, 2014, 29(146):144-166.
[15] DESEILLIGNY M P, CLERY I. Apero, An Open Source Bundle Adjusment Software for Automatic Calibration and Orientation of Set of Images[C]//Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Trento, Italy:[s.n.], 2011:269277.
[16] 杨化超, 姚国标, 王永波. 基于SIFT的宽基线立体影像密集匹配[J]. 测绘学报, 2011, 40(5):537-543. YANG Huachao, YAO Guobiao, Wang Yongbo. Dense Matching for Wide Base-line Stereo Images Based on SIFT[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(5):537-543.
[17] 王竞雪, 朱庆, 王伟玺. 多匹配基元集成的多视影像密集匹配方法[J]. 测绘学报, 2013, 42(5):691-698. WANG Jingxue, ZHU Qing, WANG Weixi. A Dense Matching Algorithm of Multi-View Image Based on the Integrated Multiple Matching Primitives[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(5):691-698.
[18] 吴军, 姚泽鑫, 程门门. 融合SIFT与SGM的倾斜航空影像密集匹配[J]. 遥感学报, 2015, 19(3):431-442. WU Jun, YAO Zexin, CHENG Menmen. Airborne Oblique Stereo Image Dense Matching by Integrating SIFT and SGM Algorithm[J]. Journal of Remote Sensing, 2015, 19(3):431-442.
[19] LOOP C, ZHANG Zhengyou. Computing Rectifying Homographies for Stereo Vision[C]//Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition. Fort Collins, CO:IEEE, 1999:1.
[20] POLLEFEYS M, KOCH R, VAN GOOL L. A Simple and Efficient Rectification Method for General Motion[C]//Proceedings of the 7th IEEE International Conference on Computer Vision. Kerkyra:IEEE, 1999, 1:496-501.
[21] MONASSE P, MOREL J M, TANG Zhongwei. Three-Step Image Rectification[C]//BMVC 2010-British Machine Vision Conference. Aberystwyth, United Kingdom:BMVA Press, 2010:89.1-89.10.