Registration of Aerial Image with Airborne LiDAR Data Based on Plücker Line

doi:10.11947/j.AGCS.2015.20140123

Abstract

Abstract: Registration of aerial image with airborne LiDAR data is a key to feature extraction. A registration model based on Plücker line is proposed. The relative position and attitude relationship between the conjugate lines in LiDAR and image is determined based on Plücker linear equation, which describes line transformation in space, then coplanarity condition equation is established. Finally, coordinate transformation between image point and corresponding LiDAR point is achieved by the spiral movement of Plücker lines in the image. The registration model of Plücker linear coplanarity condition equation is simple, and jointly describes the rotation and translation to avoid coupling error between them, so the accuracy is approved. This research provides technical support for high-quality earth spatial information acquisition.

Key words: photogrammetry, LiDAR, registration, Plücker line, coplanarity condition

CLC Number:

P237

SHENG Qinghong, CHEN Shuwen, FEI Lijia, LIU Jianfeng, WANG Huinan. Registration of Aerial Image with Airborne LiDAR Data Based on Plücker Line[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(7): 761-767.

References

[1] LI Yijing, HU Xiangyun, ZHANG Jianqing, et al. Automatic Road Extraction in Complex Scenes Based on Information Fusion from LiDAR Data and Remote Sensing Imagery[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(6): 870-876. (李怡静, 胡翔云, 张剑清, 等. 影像与LiDAR数据信息融合复杂场景下的道路自动提取[J]. 测绘学报, 2012, 41(6): 870-876.)
[2] ZHONG Cheng. High Quality True Orthoimage Generation with LiDAR and RS Image[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(1): 132. (钟成. 集成LiDAR和遥感影像生成高质量真正射影像研究[J]. 测绘学报, 2011, 40(1): 132.)
[3] WANG Yanmin, HU Chnumei. A Robust Registration Method for Terrestrial LiDAR Point Clouds and Texture Image[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(2): 266-272. (王晏民, 胡春梅. 一种地面激光雷达点云与纹理影像稳健配准方法[J]. 测绘学报, 2012, 41(2): 266-272.)
[4] DENG Fei, ZHANG Zuxun, ZHANG Jianqing. 3D Reconstruction of Old Architecture by Laser Scanner and Digital Camera[J]. Science of Surveying and Mapping, 2007, 32(2): 29-30. (邓非, 张祖勋, 张剑清. 利用激光扫描和数码相机进行古建筑三维重建研究[J]. 测绘科学, 2007, 32(2): 29-30.)
[5] POTHOU A, KARAMITSOS S, GEORGOPOULOS A, et al. Assessment and Comparison of Registration Algorithms between Aerial Images and Laser Point Clouds[J]. Revue Française de Photogrammétrie et de Télédétection, 2006(182): 28-33.
[6] ZHANG Yongjun, HU Binghua, ZHANG Jianqing. Relative Orientation Based on Multiple Conjugate Features[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(2): 194-199. (张永军, 胡丙华, 张剑清. 基于多种同名特征的相对定向方法研究[J]. 测绘学报, 2011, 40(2): 194-199.)
[7] KONG Wei, ZHANG Xueming, HE Jianmei. Spatial Resection and Forward Intersection with Generalized Point Photogrammetry[J]. Science of Surveying and Mapping, 2011, 36(5): 45-48. (孔胃, 张学明, 何建美. 基于广义点摄影测量的后方交会与前方交会方法研究[J]. 测绘科学, 2011, 36(5): 45-48.)
[8] ZHANG Zuxun, ZHANG Hongwei, ZHANG Jianqing. Automatic Absolute Orientation of Remote Sense Image by Line Photogrammetry[J]. Journal of Image and Graphics, 2005, 10(2): 213-217. (张祖勋, 张宏伟, 张剑清. 基于直线特征的遥感影像自动绝对定向[J]. 中国图象图形学报, 2005, 10(2): 213-217.)
[9] DENG Baosong, YANG Bing, WEI Yingmei, et al. 3D Reconstruction of Line Features from Multiple Views[J]. Journal of Computer-aided Design&Computer Graphics, 2007, 19(6): 713-718. (邓宝松, 杨冰, 魏迎梅, 等. 多视点图像中线特征的三维重建[J]. 计算机辅助设计与图形学学报, 2007, 19(6): 713-718.)
[10] SHAO Yongshe, LING Jing, ZHANG Shaoming, et al. Rectification Methods Based on Line Features for SPOT Imagery[J]. Journal of Tongji University(Natural Science), 2010, 38(8): 1249-1254. (邵永社, 李晶, 张绍明, 等. 基于线特征的SPOT影像几何纠正方法[J]. 同济大学学报:自然科学版, 2010, 38(8): 1249-1254.)
[11] LI Fangfang, JIA Yonghong, XIAO Benlin, et al. A Multi-sensor Image Registration Algorithm Based on Line Features and SIFT Points[J]. Geomatics and Information Science of Wuhan University, 2010, 35(2): 233-236. (李芳芳, 贾永红, 肖本林, 等. 利用线特征和SIFT点特征进行多源遥感影像配准[J]. 武汉大学学报: 信息科学版, 2010, 35(2): 233-236.)
[12] HABIB A, GHANMA M, MORGAN M, et al. Photogrammetric and LiDAR Data Registration Using Linear Features[J]. Photogrammetric Engineering and Remote Sensing, 2005, 71(6): 699-707.
[13] DENG Fei. Research on LiDAR and Digital Images Registration and Objects Extraction[D]. Wuhan: Wuhan University, 2006. (邓非. LiDAR数据与数字影像的配准和地物提取研究[D]. 武汉: 武汉大学, 2006.)
[14] MA Hongchao, YAO Chunjing, WU Jianwei. Registration of LiDAR Point Clouds and High Resolution Images Based on Linear Features[J]. Geomatics and Information Science of Wuhan University, 2012, 37(2): 136-140, 159. (马洪超, 姚春静, 邬建伟. 利用线特征进行高分辨率影像与LiDAR点云的配准[J]. 武汉大学学报: 信息科学版, 2012, 37(2): 136-140, 159.)
[15] ZHANG Yongjun, XIONG Xiaodong, SHEN Xiang. Automatic Registration of Urban Aerial Imagery with Airborne LiDAR Data[J]. Journal of Remote Sensing, 2012, 16(3): 579-595. (张永军, 熊小东, 沈翔. 城区机载LiDAR数据与航空影像的自动配准[J]. 遥感学报, 2012, 16(3): 579-595.)
[16] HABIB A F, GHANMA M S, MITISHITA E A, et al. Image Georeferencing Using LiDAR Data[C]//Proceedings of 25th IEEE International Geoscience and Remote Sensing Symposium. Seoul: [s.n.], 2005: 1158-1161.
[17] CHOI K, HONG J, LEE I. Precise Geometric Registration of Aerial Imagery and LiDAR Data[J]. ETRI Journal, 2011, 33(4): 506-516.
[18] FUNDA J, TAYLOR R H, PAUL R P. On Homogeneous Transforms, Quaternions, and Computational Efficiency[J]. IEEE Transactions on Robotics and Automation, 1990, 6(3): 382-388.
[19] RONDA J I, GALLEGO G, VALDES A. Camera Autocalibration Using Plücker Coordinates[C]//Proceedings of IEEE International Conference on Image Processing 2005. Genoa: [s.n.], 2005: 3125-3128.
[20] SARIYILDIZ E, TEMELTAS H. Solution of Inverse Kinematic Problem for Serial Robot Using Dual Quaternions and Plücker Coordinates[C]//Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Singapore: [s.n.], 2009: 338-343.
[21] LI Jing, WANG Huinan, LIU Haiying. Plucker Linear Based Relative Position and Attitude Determination Algorithm for RVD[J]. Chinese Space Science and Technology, 2013, 33(1): 69-74. (李静, 王惠南, 刘海颖. 基于普吕克直线的交会对接相对位姿确定算法[J]. 中国空间科学技术, 2013, 33(1): 69-74.)
[22] ROONY J. A Comparison of Representation of General Spatial Screw Displacement[J]. Environment and Planning, 1978, 5(1): 45-88.
[23] PENNESTRI E,STEFANELLI R. Linear Algebra and Numerical Algorithms Using Dual Numbers[J]. Multibody System Dynamics, 2007, 18(3): 323-344.
[24] ZHANG Yongjun, ZHANG Zuxun, ZHANG Jianqing. Dimensional Inspection of Industrial Parts with Image Sequence[J]. Journal of Shanghai Jiaotong University, 2003, 37(9): 1447-1451. (张永军, 张祖勋, 张剑清. 基于序列图像的工业零件尺寸检测技术[J]. 上海交通大学学报, 2003, 37(9): 1447-1451.)
[25] LIU Weiwei. Positioning of Mars Probes Based on Imaging Geometric Models[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2012. (刘微微. 基于成像几何模型的火星探测器定位研究[D]. 南京: 南京航空航天大学, 2012.)
[26] QIAN Ping. A Research Based on Dual Quaternion for Relative Position and Attitude Determination of RVD Spacecrafts[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2011. (钱萍. 基于对偶四元数的航天器交会对接位姿关键技术研究[D]. 南京:南京航空航天大学, 2011.)
[27] QIAN Ping, WANG Huinan. A Binocular Vision Algorithm Based on Dual Quaternion for Relative Position and Attitude Determination of RVD Spacecrafts[J]. Journal of Astronautics, 2013, 34(1): 32-38. (钱萍, 王惠南. 基于对偶四元数的航天器交会对接位姿双目视觉测量算法[J]. 宇航学报, 2013, 34(1): 32-38.)
[28] ZHANG Jianqing, PAN Li, WANG Shugen. Geo-spatial Information Science[M]. Wuhan: Wuhan University Press, 2009: 28. (张剑清, 潘励, 王树根. 摄影测量学[M]. 武汉: 武汉大学出版社, 2009: 28.)