Automatic Registration of Low Altitude UAV Sequent Images and Laser Point Clouds

doi:10.11947/j.AGCS.2015.20130558

Abstract

Abstract:

It is proposed that a novel registration method for automatic co-registration of unmanned aerial vehicle (UAV) images sequence and laser point clouds. Firstly, contours of building roofs are extracted from the images sequence and laser point clouds using marked point process and local salient region detection, respectively. The contours from each data are matched via back-project proximity. Secondly, the exterior orientations of the images are recovered using a linear solver based on the contours corner pairs followed by a co-planar optimization which is implicated by the matched lines form contours pairs. Finally, the exterior orientation parameters of images are further optimized by matching 3D points generated from images sequence and laser point clouds using an iterative near the point (ICP) algorithm with relative movement threshold constraint. Experiments are undertaken to check the validity and effectiveness of the proposed method. The results show that the proposed method achieves high-precision co-registration of low-altitude UAV image sequence and laser points cloud robustly. The accuracy of the co-produced DOMs meets 1:500 scale standards.

Key words: airborne LiDAR point cloud, UAV image sequences, registration, UAV

CLC Number:

P237

CHEN Chi, YANG Bisheng, PENG Xiangyang. Automatic Registration of Low Altitude UAV Sequent Images and Laser Point Clouds[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(5): 518-525.

References

[1] BALTSAVIAS E A. Comparison between Photogrammetry and Laser Scanning[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 1999, 54(2): 83-94.
[2] HABIB A F, GHANMA M S, TAIT M. Integration of LiDAR and Photogrammetry for Close Range Applications[R]. International Archives of Photogrammetry and Remote Sensing. Istanbul:[s.n.], 2004.
[3] HABIB A F, RUIFANG Z, KIM C. Generation of Complex Polyhedral Building Models by Integrating Stereo-aerial Imagery and LiDAR Data[J]. Photogrammetric Engineering and Remote Sensing, 2010, 76(5): 609-623.
[4] HUDAK A T, LEFSKY M A, COHEN W B, et al. Integration of LiDAR and Landsat ETM+Data for Estimating and Mapping Forest Canopy Height[J]. Remote Sensing of Environment, 2002, 82(2): 397-416.
[5] NAIDOO L, CHO M A, MATHIEU R, et al. Classification of Savanna Tree Species, in the Greater Kruger National Park Region, by Integrating Hyper-spectral and LiDAR Data in a Random Forest Data Mining Environment[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2012, 69(4):167-179.
[6] LI Yijing, HU Xiangyun, ZHANG Jianqing, et al. Automatic Road Extraction in Complex Scenes Based on Information Fusion from LiDAR Data and Remote Sensing Imagery[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(6): 870-876. (李怡静, 胡翔云, 张剑清, 等. 影像与LiDAR数据信息融合复杂场景下的道路自动提取[J]. 测绘学报, 2012, 41(6): 870-876.)
[7] WU Hangbin. Classification and Feature Extraction of Airborne LiDAR Data Fused with Aerial Image[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(1): 134-134. (吴杭彬. 融合航空影像的机载激光扫描数据分类与特征提取[J]. 测绘学报, 2011, 40(1): 134-134.)
[8] STAMOS I, LIU L, CHEN C, et al. Integrating Automated Range Registration with Multiviews Geometry for the Photo-realistic Modeling of Large-scale Scenes[J]. International Journal of Computer Vision, 2008, 78(2-3): 237-260.
[9] DING M, LYNGBAEK K, ZAKHOR A. Automatic Registration of Aerial Imagery with Untextured 3D LiDAR Models[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Anchorage: IEEE, 2008: 1-8.
[10] ZHONG Cheng, LI Hui, HUANG Xianfeng, et al. Automatic Registration of LiDAR Data and Aerial Image Based on a 6 Tuples Relaxation[J]. Geomatics and Information Science of Wuhan University, 2009, 34(12): 1426-1430. (钟成, 李卉, 黄先锋, 等. 利用 6 元组松弛法自动配准 LiDAR 数据与航空影像[J]. 武汉大学学报: 信息科学版, 2009, 34(12): 1426-1430.)
[11] DENG Fei, ZHANG Zuxun, ZHANG Jianqing. Three-dimensional Reconstruction of Ancient Architecture Using Laser Scanner and Digital Camera[J]. Science of Surveying and Mapping, 2007, 32(2): 29-30. (邓非, 张祖勋, 张剑清. 利用激光扫描和数码相机进行古建筑三维重建研究[J]. 测绘科学, 2007, 32(2): 29-30.)
[12] HABIB A, GHANMA M, MORGAN M, et al. Photogrammetric and LiDAR Data Registration Using Linear Features[J]. Photogrammetric Engineering and Remote Sensing, 2005, 71(6): 699-707.
[13] MA Hongchao, YAO Chunjing, WU Jianwei. Registration of LiDAR Point Clouds and High Resolution Images Based on Linear Feature[J]. Geomatics and Information Science of Wuhan University, 2012, 37(2): 136-140. (马洪超, 姚春静, 邬建伟. 利用线特征进行高分辨率影像与 LiDAR 点云的配准[J]. 武汉大学学报: 信息科学版, 2012, 37(2): 136-140.)
[14] WANG Yanmin, HU Chunmei. A Robust Registration Method for Terrestrial LiDAR Point Clouds and Texture Image[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(2): 266-272. (王晏民, 胡春梅. 一种地面激光雷达点云与纹理影像稳健配准方法[J]. 测绘学报, 2012, 41(2): 266-272.)
[15] FRUEH C, SAMMON R, ZAKHOR A. Automated Texture Mapping of 3D City Models with Oblique Aerial Imagery[C]//Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission.[S.l.]: IEEE, 2004: 396-403.
[16] MASTIN A, KEPNER J, FISHER J. Automatic Registration of LiDAR and Optical Images of Urban Scenes[C]//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami: IEEE, 2009: 2639-2646.
[17] ZHAO W, NISTER D, HSU S. Alignment of Continuous Video onto 3D Point Clouds[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(8): 1305-1318.
[18] ZHONG Liang, MA Hongchao, GUAN Haiyan, et al. Boresight Calibration Based Fast Registration between Airborne LiDAR Points Clouds and Synchronous Images[J]. Geomatics and Information Science of Wuhan University, 2011, 36(9): 1035-1038. (钟良, 马洪超, 管海燕, 等. 利用安置角检校进行机载 LiDAR点云数据与同步影像快速配准[J]. 武汉大学学报: 信息科学版, 2011, 36(9): 1035-1038.)
[19] WU Shenghao, ZHONG Ruofei. The 3D Visualization's Approach Based on Vehicle-borne Laser Scanning[J]. Journal of Capital Normal University: Natural Science Edition, 2011, 32(4): 57- 61. (吴胜浩, 钟若飞. 基于移动平台的激光点云与数字影像融合方法[J]. 首都师范大学学报: 自然科学版, 2011, 32(4): 57-61.)
[20] YANG B S, XU W X, DONG Z. Automated Extraction of Building Outlines from Airborne Laser Scanning Point Clouds[J]. IEEE Geoscience and Remote Sensing Letters, 2013, 10(6): 1399-1403.
[21] KWAK E. Automatic 3D Building Model Generation by Integrating LiDAR and Aerial Images Using a Hybrid Approach[D]. Calgary: University of Calgary, 2013.
[22] CHENG M M, ZHANG G X, MITRA N J, et al. Global Contrast Based Salient Region Detection[C]//Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition. Providence: IEEE, 2011: 409-416.
[23] AWRANGJEB M, LU G, FRASER C S. Performance Comparisons of Contour-based Corner Detectors[J]. IEEE Transactions on Image Processing, 2012, 21(9): 4167-4179.
[24] LEPETIT V, MORENO-NOGUER F, FUA P. EPnP: An Accurate O(n) Solution to the PnP Problem[J]. International Journal of Computer Vision, 2009, 81(2): 155-166.
[25] LI Deren, YUAN Xiuxiao. Error Processing and Reliability Theory[M]. Wuhan University Press, 2002. (李德仁, 袁修孝. 误差处理与可靠性理论[M]. 武汉: 武汉大学出版社, 2002.)
[26] LAFARGE F, KERIVEN R, BRéDIF M, et al. A Hybrid Multi-view Stereo Algorithm for Modeling Urban Scenes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(1):5-17.
[27] POMERLEAU F, COLAS F, FERLAND F, et al. Relative Motion Threshold for Rejection in ICP Registration[C]//Field and Service Robotics.Berlin: Springer, 2010: 229-238.
[28] ZHANG Yongjun, HU Binghua, ZHANG Jianqing. Absolute Orientation of Large Rotation Angle Images[J]. Geomatics and Information Science of Wuhan University,2010, 35(4): 427-431. (张永军, 胡丙华, 张剑清. 大旋角影像的绝对定向方法研究[J]. 武汉大学学报: 信息科学版, 2010, 35(4): 427-431.)