球形全景影像位姿估计的改进EPnP算法

doi:10.11947/j.AGCS.2016.20150411

测绘学报 ›› 2016, Vol. 45 ›› Issue (6): 677-684.doi: 10.11947/j.AGCS.2016.20150411

球形全景影像位姿估计的改进EPnP算法

邓非^1,2, 吴幼丝¹, 胡玉雷³, 崔红霞⁴

1. 武汉大学测绘学院, 湖北武汉 430079;
2. 武汉大学国家领土主权与海洋权益协同创新中心, 湖北武汉 430079;
3. 中铁第四勘察设计院集团有限公司, 湖北武汉 430063;
4. 渤海大学信息科学与技术学院, 辽宁锦州 121013

收稿日期:2015-08-12 修回日期:2016-04-10 出版日期:2016-06-20 发布日期:2016-06-29
通讯作者: 吴幼丝 E-mail:yousiwu@whu.edu.cn E-mail:yousiwu@whu.edu.cn
作者简介:邓非(1976-)男,博士,教授,研究方向为数字摄影测量。E-mail:fdemg@sgg.whu.edu.cn
基金资助:
国家自然科学基金(41271431)

Position and Pose Estimation of Spherical Panoramic Image with Improved EPnP Algorithm

DENG Fei^1,2, WU Yousi¹, HU Yulei³, CUI Hongxia⁴

1. School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China;
2. Collaborative Innovation Center for Territorial Sovereignty and Maritime Rights, Wuhan University, Wuhan 430079, China;
3. China Railway Siyuan Survey and Design Group CO., LTD., Wuhan 430063, China;
4. School of Information Science and Technology, Bohai University, Jinzhou 121013, China

Received:2015-08-12 Revised:2016-04-10 Online:2016-06-20 Published:2016-06-29
Supported by:
The National Natural Science Foundation of China(No.41271431)

摘要/Abstract

摘要： 球形全景成像可以克服透视成像视场角的局限,实现场景全覆盖的三维重建和量测。本文在普通影像位姿估计的EPnP(efficient perspective-n-point)算法上进行了改进和扩展,提出了一种稳健快速的球形全景影像位姿估计算法。首先,构建球形全景影像的投影模型,将EPnP算法的平面透视成像模型扩展到球面成像模型;然后,采用基于全景球心、像点、控制点共线条件方程的改进EPnP算法求解控制点的球形全景像空间坐标;最后,利用Horn绝对定位算法直接解算全景影像位姿。与球形全景影像位姿估计的后方交会算法的对比试验结果表明,本文提出的方法无须迭代求解,更为稳健快速,即使控制点数目较少也能达到高精度,基于非严格共中心拼接的全景相机,重投影误差可控制在3.00像素左右。

关键词: 球形全景影像, 位姿估计, EPnP(efficient perspective-n-point)算法

Abstract: Spherical panoramic imaging can overcome the limitations of perspective imaging's range of view and achieve three-dimensional reconstruction and measurement with full coverage.The EPnP(efficient perspective-n-point) algorithm fit for ordinary image's position and pose estimation is improved and extended by this paper to put forward a robust and fast method to estimate spherical panoramic image's position and pose. Firstly,we construct the projection model of spherical panoramic image to extend the perspective plane imaging model of EPnP algorithm to the spherical imaging model;then with the improved EPnP algorithm basing on the condition equation that panoramic sphere center,image point and control point are collinear, we obtain the control points' coordinates in spherical panoramic image space; finally, we solve the spherical panoramic image's position and pose directly with the Horn absolute positioning algorithm. Compared with the position and pose estimation method of spherical panoramic image with the resection algorithm, the experiment results show that the method proposed in this paper can achieve higher robustness, higher efficiency without going through an iterative solution, and it can also achieve high accuracy with a few control points.Based on the panoramic camera stitching with non-strict center, the reprojection error can be controlled around 3.00 pixel level.

Key words: spherical panoramic image, position and pose estimation, EPnP(efficient perspective-n-point) algorithm

中图分类号:

P232

邓非, 吴幼丝, 胡玉雷, 崔红霞. 球形全景影像位姿估计的改进EPnP算法[J]. 测绘学报, 2016, 45(6): 677-684.

DENG Fei, WU Yousi, HU Yulei, CUI Hongxia. Position and Pose Estimation of Spherical Panoramic Image with Improved EPnP Algorithm[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(6): 677-684.

参考文献

[1] 李霖,于忠海,李桢, 等. 全景景观地图中地形局部变形研究[J]. 武汉大学学报(信息科学版), 2013, 38(11):1335-1338, 1343. LI Lin, YU Zhonghai, LI Zhen, et al. Local Terrain Deformation in Panoramic Maps[J]. Geomatics and Information Science of Wuhan University, 2013, 38(11):1335-1338, 1343.
[2] 张烁, 李群智, 温博, 等. 玉兔号月球车全景相机的正交变换投影模型[J]. 武汉大学学报(信息科学版), 2014, 39(7):804-808. ZHANG Shuo, LI Qunzhi, WEN Bo, et al. Orthogonal Projection Model of Jade Rabbit Lunar Rover Pancam[J]. Geomatics and Information Science of Wuhan University, 2014, 39(7):804-808.
[3] TONG Guofeng,LIU Ran, TAN Jindong. 3D Information Retrieval in Mobile Robot Vision Based on Spherical Compound Eye[C]//Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics. Karon Beach, Phuket:IEEE, 2011:1895-1900.
[4] TONG Guofeng, WU Zizhang, WENG Ninglong, et al. An Omni-directional vSLAM Based on Spherical Camera Model and 3D Modeling[C]//Proceedings of the 10th World Congress on Intelligent Control and Automation. Beijing:IEEE, 2012:4551-4556.
[5] TONG Guofeng, GU Jiuhong. Locating Objects in Spherical Panoramic Images[C]//Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics. Karon Beach, Phuket:IEEE, 2011:818-823.
[6] 徐芳, 梅文胜, 张利. 线阵全景相机检校模型研究[J]. 武汉大学学报(信息科学版), 2014, 39(4):417-421. XU Fang, MEI Wensheng, ZHANG Li. The Calibration Model of Linear Array Panoramic Cameras[J]. Geomatics and Information Science of Wuhan University, 2014, 39(4):417-421.
[7] 李晓辉, 周荫清, 王祖林. 基于曲面拼接的球面全景生成算法[J]. 北京航空航天大学学报, 2007, 33(6):668-671, 681. LI Xiaohui, ZHOU Yinqing, WANG Zulin. Spherical Panorama Creating Algorithm Based on Curve Surface Mosaic[J]. Journal of Beijing University of Aeronautics and Astronautics, 2007, 33(6):668-671, 681.
[8] 龚琪慧, 吴健平, 王洁华, 等. 基于全景图的3维实景制作及其与GIS集成研究[J]. 测绘与空间地理信息, 2012, 35(6):33-37. GONG Qihui, WU Jianping, WANG Jiehua, et al. The Research of the Production of 3D Real Scene and the GIS Integration Thereof Based on Panorama[J]. Geomatics & Spatial Information Technology, 2012, 35(6):33-37.
[9] TONG Guofeng,PANG Xiaolei,YE Ning,et al. A Precise Spherical Camera Model Based on Multi-camera System[J]. Journal of Computational Information Systems, 2013, 9(3):897-905.
[10] BROWN M, LOWE D G. Automatic Panoramic Image Stitching Using Invariant Features[J]. International Journal of Computer Vision, 2007, 74(1):59-73.
[11] 季顺平, 史云. 车载全景相机的影像匹配和光束法平差[J]. 测绘学报, 2013, 42(1):94-100. JI Shunping, SHI Yun. Image Matching and Bundle Adjustment Using Vehicle-based Panoramic Camera[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(1):94-100.
[12] 张正鹏, 江万寿, 张靖. 光流特征聚类的车载全景序列影像匹配方法[J]. 测绘学报, 2014, 43(12):1266-1273.DOI:10.13485/j.cnki.11-2089.2014.0172. ZHANG Zhengpeng, JIANG Wanshou, ZHANG Jing. An Image Match Method Based on Optical Flow Feature Clustering for Vehicle-borne Panoramic Image Sequence[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(12):1266-1273. DOI:10.13485/j.cnki.11-2089.2014.0172.
[13] 刘帅, 陈军, 孙敏, 等. 一种球形立体全景的三维量测算法与实验[J]. 地球信息科学学报, 2014, 16(1):15-22. LIU Shuai, CHEN Jun, SUN Min, et al. A Three Dimensional Measurement Approach and Experiment Based on Spherical Panorama[J]. Journal of Geo-Information Science, 2014, 16(1):15-22.
[14] 刘帅, 陈军, 孙敏, 等. 双球面投影几何可量测全景模型的构建[J]. 计算机辅助设计与图形学学报, 2015, 27(4):657-665. LIU Shuai, CHEN Jun, SUN Min, et al. Measurable Panorama Construction Based on Binocular Spherical Projective Geometry[J]. Journal of Computer-aided Design & Computer Graphics, 2015, 27(4):657-665.
[15] 季顺平, 史云. 高噪声环境下基于参考影像的车载序列影像定位方法[J]. 测绘学报, 2014, 43(11):1174-1181.DOI:10.13485/j.cnki.11-2089.2014.0181. JI Shunping, SHI Yun. Georegistration of Ground Sequential Imagery with Geo-referenced Aerial Images in High Noise Environments[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(11):1174-1181. DOI:10.13485/j.cnki.11-2089.2014.0181.
[16] 季顺平, 史云. 多镜头组合型全景相机两种成像模型的定位精度比较[J]. 测绘学报, 2014, 43(12):1252-1258.DOI:10.13485/j.cnki.11-2089.2014.0169. JI Shunping, SHI Yun. Comparison of Two Sensor Models for Multi-camera Rig System in Measurements[J]. Acta Geodaetica et Cartographica Sinica,2014, 43(12):1252-1258. DOI:10.13485/j.cnki.11-2089.2014.0169.
[17] 石丽梅, 赵红蕊, 李明海, 等. 车载移动测图系统外方位元素标定方法[J]. 测绘学报, 2015, 44(1):52-58.DOI:10.11947/j.AGCS.2015.20130203. SHI Limei, ZHAO Hongrui, LI Minghai, et al. Extrinsic Calibration for Vehicle-based Mobile Mapping System[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(1):52-58. DOI:10.11947/j.AGCS.2015.20130203.
[18] LEPETIT V, MORENO-NOGUER F,FUA P. EPnP:An Accurate O(n) Solution to the PnP Problem[J]. International Journal of Computer Vision, 2009, 81(2):155-166.
[19] HORN B K P, HILDEN H M, NEGAHDARIPOUR S. Closed-form Solution of Absolute Orientation Using Orthonormal Matrices[J]. Journal of the Optical Society of America A, 1988, 5(7):1127-1135.
[20] 王佩军, 徐亚明. 摄影测量学[M]. 武汉:武汉大学出版社, 2005. WANG Peijun, XU Yaming. Photogrammetry[M]. Wuhan:Wuhan University Press, 2005.

球形全景影像位姿估计的改进EPnP算法

Position and Pose Estimation of Spherical Panoramic Image with Improved EPnP Algorithm

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	康俊华. 基于全卷积神经网络的端到端立体密集匹配研究[J]. 测绘学报, 2022, 51(5): 785-785.
[2]	李佳田, 王聪聪, 阿晓荟, 晏玲, 朱志浩, 高鹏. 多向前方交会与单隐层神经网络结合的近景前方交会法[J]. 测绘学报, 2020, 49(6): 736-745.
[3]	闫利, 戴集成, 谭骏祥, 刘华, 陈长军. SLAM激光点云整体精配准位姿图技术[J]. 测绘学报, 2019, 48(3): 313-321.
[4]	张春森, 张萌萌, 郭丙轩. 影像信息驱动的三角网格模型优化方法[J]. 测绘学报, 2018, 47(7): 959-967.
[5]	闫利, 谭骏祥, 刘华, 陈长军. 融合遗传算法和ICP的地面与车载激光点云配准[J]. 测绘学报, 2018, 47(4): 528-536.
[6]	张帆, 黄印, 黄先锋, 徐思奇. 非直视区域的普通平面镜辅助地面三维激光扫描方法[J]. 测绘学报, 2017, 46(12): 1950-1958.
[7]	王祥, 张永军, 黄山, 谢勋伟. 旋转多基线摄影光束法平差法方程矩阵带宽优化[J]. 测绘学报, 2016, 45(2): 170-177.
[8]	刘祥磊, 童小华, 马静. 视频测量影像序列椭圆形人工目标点快速识别和跟踪方法[J]. 测绘学报, 2015, 44(6): 663-669.
[9]	姚吉利, 马宁, 贾象阳, 徐广鹏, 谢建春. 球形标靶的固定式扫描大点云自动定向方法[J]. 测绘学报, 2015, 44(4): 431-437.
[10]	浦石李京伟郭四清. 融合语义特征与GPS位置的地面激光点云拼接方法[J]. 测绘学报, 2014, 43(5): 545-550.
[11]	李畅. 利用灭点进行相机检校与定姿的充要条件及其不确定性分析[J]. 测绘学报, 2012, 41(6): 851-856.
[12]	李清泉, 黄惠, 姜三, 胡庆武, 于文率. 优视摄影测量方法及精度分析[J]. 测绘学报, 2022, 51(6): 996-1007.
[13]	刘华. 车载激光点云地物提取与分类研究[J]. 测绘学报, 2020, 49(11): 1506-1506.
[14]	李帅鑫, 李九人, 田滨, 陈龙, 王力, 李广云. 面向点云退化的隧道环境的无人车激光SLAM方法[J]. 测绘学报, 2021, 50(11): 1487-1499.
[15]	孙喜亮, 关宏灿, 苏艳军, 徐光彩, 郭庆华. 面向高精度城市测绘的激光紧耦合SLAM方法[J]. 测绘学报, 2021, 50(11): 1585-1593.