Automatic Tie-points Extraction for Triangulation of Large-scale Oblique Multi-view Images

doi:10.11947/j.AGCS.2016.20140673

Abstract

Abstract: A new tie-points extraction and bundle block adjustment method for large-scale multi-view oblique images is presented. Firstly, exterior orientation data gained by POS are used to rectify oblique images and predict image correspondences, which can be matched using SIFT algorithm. Secondly, an unordered feature tracking method relies on union-find algorithm are adapted to detect the multi-view correspondences. After tie-points extracted, bundle adjustment are done with POS and control points data treated as weighted measurement. In the experiment part, three kinds of oblique images, taken by assembled lightweight oblique system, UltraCam and SWDC-5, are used to test the algorithm above. The results show that our method can adapt the popular oblique systems at home and abroad, which can process over 2000 images at a time. And the precision of oblique triangulation is better than the traditional vertical triangulation, with an accuracy of 0.75 GSD in horizontal direction, 2.0 GSD in elevation direction.

Key words: oblique images, automatic triangulation, bundle block adjustment, tie-points extraction

CLC Number:

P231

YAN Li, FEI Liang, YE Zhiyun, XIA Wang. Automatic Tie-points Extraction for Triangulation of Large-scale Oblique Multi-view Images[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(3): 310-317.

References

[1] RUPNIK E, NEX F, REMONDINO F. Oblique Multi-camera Systems-orientation and Dense Matching Issues[C]//International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-3/W1, EuroCOW 2014, the European Calibration and Orientation Workshop. Castelldefels:ISPRS,2014:107-114.
[2] FDIETER D, RDIETER M. Oblique Image Data Processing:Potential, Experiences and Recommendations[EB/OL].(2013-06-08)[2014-01-30]. http://www.ifp.uni-stuttgart.de/publications/phowo13/090Fritsch.pdf
[3] KARBØ N, SCHROTH R. Oblique Aerial Photography:A Status Review[EB/OL].(2009-10-03)[2014-01-30]. http://www.ifp.uni-stuttgart.de/publications/phowo09/140Karbo.pdf
[4] WANG Yandong, SCHULTZ S, GIUFFRIDA F. Pictometry's Proprietary Airborne Digital Imaging System and Its Application in 3D City Modelling[C]//International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences:XXXVⅡ(B1). Beijing:ISPRS,2008:1065-1069.
[5] GRUBER M, PONTICELLI M, WIECHERT A. UltraCam, A Brand for Continuous Devlopments[EB/OL].(2011-11-25)[2014-01-30]. http://www.ifp.uni-stuttgart.de/publications/phowo11/110Gruber.pdf
[6] SHRAGAI Z, EVEN-PAZ A, KLEIN I. Automatic Tie-point Extraction Using Advanced Approaches[C]//Proceedings of the ASPRS 2011 Annual Conference.Milwaukee,Wisconsin:[s.n.],2011.
[7] CODREANU V, DONG Feng, LIU Baoquan, et al. Gpu-Asift:A Fast Fully Affine-invariant Feature Extraction Algorithm[C]//Proceedings of 2013 International Conference on High Performance Computing and Simulation. Helsinki:IEEE, 2013:474-481.
[8] MOREL J M, YU Guoshen. Asift:A New Framework for Fully Affine Invariant Image Comparison[J]. SIAM Journal on Imaging Sciences, 2009, 2(2):438-469.
[9] YU Guoshen, MOREL J M. A Fully Affine Invariant Image Comparison Method[C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing.Taipei:IEEE, 2009:1597-1600.
[10] MIKOLAJCZYK K, SCHMID C. Scale & Affine Invariant Interest Point Detectors[J]. International Journal of Computer Vision, 2004, 60(1):63-86.
[11] MIKOLAJCZYK K,TUYTELAARS T,SCHMID C,et al. A Comparison of Affine Region Detectors[J]. International Journal of Computer Vision, 2005, 65(1-2):43-72.
[12] YANG Huachao,ZHANG Shubi,WANG Yongbo.Robust and Precise Registration of Oblique Images Based on Scale-invariant Feature Transformation Algorithm[J]. IEEE Geoscience and Remote Sensing Letters,2012, 9(4):783-787.
[13] MOULON P, MONASSE P. Unordered Feature Tracking Made Fast and Easy[C]//Proceedings of the 9th European Conference on Visual Media Production. London:CVMP,2012.
[14] RUPNIK E, NEX F, REMONDINO F. Automatic Orientation of Large Blocks of Oblique Images[C]//International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-1/W1, ISPRS Hannover Workshop 2013.Hannover:ISPRS,2013:299-304.
[15] GERKE M, NYARUHUMA A. Incorporating Scene Constraints into the Triangulation of Airborne Oblique Images[C]//ISPRS Conference:High-resolution Earth Imaging for Geospatial Information:ISPRS XXXVⅢ 1-4-7/WS. Hannover:ISPRS, 2009:4-7.
[16] 袁修孝. POS辅助光束法区域网平差[J]. 测绘学报, 2008, 37(3):342-348. YUAN Xiuxiao. POS-supported Bundle Block Adjustment[J]. Acta Geodaetica et Cartographica Sinica, 2008, 37(3):342-348.
[17] 袁修孝, 明洋. POS辅助航带间航摄影像的自动转点[J]. 测绘学报, 2010, 39(2):156-161. YUAN Xiuxiao, MING Yang. POS-supported Matching Method for Aerial Images between Neighboring Strips[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(2):156-161.[18] LOWE D G. Distinctive Image Features from Scale-Invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[19] SUN Yanbiao, ZHAO Liang, HUANG Shoudong, et al. L²-SIFT:SIFT Feature Extraction and Matching for Large Images in Large-scale Aerial Photogrammetry[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014, 91:1-16.
[20] WU Changchang. Siftgpu:A Gpu Implementation of Scale Invariant Feature Transform(SIFT)[EB/OL].(2009-10-03)[2014-01-30]. http://www.cs.unc.edu/~ccwu/siftgpu/
[21] FISCHLER M A, BOLLES R C. Random Sample Consensus:A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography[J]. Communications of the ACM, 1981, 24(6):381-395.
[22] 李德仁, 袁修孝. 误差处理与可靠性理论[M]. 武汉:武汉大学出版社, 2002. LI Deren, YUAN Xiuxiao. Error Processing and Reliability Theory[M]. Wuhan:Wuhan University Press, 2002.