球形全景影像位姿估计的改进EPnP算法

邓非; 吴幼丝; 胡玉雷; 崔红霞

doi:10.11947/j.AGCS.2016.20150411

测绘学报 >

2016 , Vol. 45 >Issue 6: 677 - 684

DOI: https://doi.org/10.11947/j.AGCS.2016.20150411

摄影测量学与遥感

球形全景影像位姿估计的改进EPnP算法

邓非 ,
吴幼丝 ,
胡玉雷 ,
崔红霞

展开

1. 武汉大学测绘学院, 湖北武汉 430079;
2. 武汉大学国家领土主权与海洋权益协同创新中心, 湖北武汉 430079;
3. 中铁第四勘察设计院集团有限公司, 湖北武汉 430063;
4. 渤海大学信息科学与技术学院, 辽宁锦州 121013

邓非(1976-)男,博士,教授,研究方向为数字摄影测量。E-mail:fdemg@sgg.whu.edu.cn

收稿日期: 2015-08-12

修回日期: 2016-04-10

网络出版日期: 2016-06-29

基金资助

国家自然科学基金(41271431)

收起

Position and Pose Estimation of Spherical Panoramic Image with Improved EPnP Algorithm

DENG Fei ,
WU Yousi ,
HU Yulei ,
CUI Hongxia

Expand

1. School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China;
2. Collaborative Innovation Center for Territorial Sovereignty and Maritime Rights, Wuhan University, Wuhan 430079, China;
3. China Railway Siyuan Survey and Design Group CO., LTD., Wuhan 430063, China;
4. School of Information Science and Technology, Bohai University, Jinzhou 121013, China

Received date: 2015-08-12

Revised date: 2016-04-10

Online published: 2016-06-29

Supported by

The National Natural Science Foundation of China(No.41271431)

Fold

摘要

球形全景成像可以克服透视成像视场角的局限,实现场景全覆盖的三维重建和量测。本文在普通影像位姿估计的EPnP(efficient perspective-n-point)算法上进行了改进和扩展,提出了一种稳健快速的球形全景影像位姿估计算法。首先,构建球形全景影像的投影模型,将EPnP算法的平面透视成像模型扩展到球面成像模型;然后,采用基于全景球心、像点、控制点共线条件方程的改进EPnP算法求解控制点的球形全景像空间坐标;最后,利用Horn绝对定位算法直接解算全景影像位姿。与球形全景影像位姿估计的后方交会算法的对比试验结果表明,本文提出的方法无须迭代求解,更为稳健快速,即使控制点数目较少也能达到高精度,基于非严格共中心拼接的全景相机,重投影误差可控制在3.00像素左右。

关键词： 球形全景影像; 位姿估计; EPnP(efficient perspective-n-point)算法

本文引用格式

邓非 , 吴幼丝 , 胡玉雷 , 崔红霞 . 球形全景影像位姿估计的改进EPnP算法[J]. 测绘学报, 2016 , 45(6) : 677 -684 . DOI: 10.11947/j.AGCS.2016.20150411

Abstract

Spherical panoramic imaging can overcome the limitations of perspective imaging's range of view and achieve three-dimensional reconstruction and measurement with full coverage.The EPnP(efficient perspective-n-point) algorithm fit for ordinary image's position and pose estimation is improved and extended by this paper to put forward a robust and fast method to estimate spherical panoramic image's position and pose. Firstly,we construct the projection model of spherical panoramic image to extend the perspective plane imaging model of EPnP algorithm to the spherical imaging model;then with the improved EPnP algorithm basing on the condition equation that panoramic sphere center,image point and control point are collinear, we obtain the control points' coordinates in spherical panoramic image space; finally, we solve the spherical panoramic image's position and pose directly with the Horn absolute positioning algorithm. Compared with the position and pose estimation method of spherical panoramic image with the resection algorithm, the experiment results show that the method proposed in this paper can achieve higher robustness, higher efficiency without going through an iterative solution, and it can also achieve high accuracy with a few control points.Based on the panoramic camera stitching with non-strict center, the reprojection error can be controlled around 3.00 pixel level.

Key words： spherical panoramic image; position and pose estimation; EPnP(efficient perspective-n-point) algorithm

参考文献

[1] 李霖,于忠海,李桢, 等. 全景景观地图中地形局部变形研究[J]. 武汉大学学报(信息科学版), 2013, 38(11):1335-1338, 1343. LI Lin, YU Zhonghai, LI Zhen, et al. Local Terrain Deformation in Panoramic Maps[J]. Geomatics and Information Science of Wuhan University, 2013, 38(11):1335-1338, 1343.
[2] 张烁, 李群智, 温博, 等. 玉兔号月球车全景相机的正交变换投影模型[J]. 武汉大学学报(信息科学版), 2014, 39(7):804-808. ZHANG Shuo, LI Qunzhi, WEN Bo, et al. Orthogonal Projection Model of Jade Rabbit Lunar Rover Pancam[J]. Geomatics and Information Science of Wuhan University, 2014, 39(7):804-808.
[3] TONG Guofeng,LIU Ran, TAN Jindong. 3D Information Retrieval in Mobile Robot Vision Based on Spherical Compound Eye[C]//Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics. Karon Beach, Phuket:IEEE, 2011:1895-1900.
[4] TONG Guofeng, WU Zizhang, WENG Ninglong, et al. An Omni-directional vSLAM Based on Spherical Camera Model and 3D Modeling[C]//Proceedings of the 10th World Congress on Intelligent Control and Automation. Beijing:IEEE, 2012:4551-4556.
[5] TONG Guofeng, GU Jiuhong. Locating Objects in Spherical Panoramic Images[C]//Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics. Karon Beach, Phuket:IEEE, 2011:818-823.
[6] 徐芳, 梅文胜, 张利. 线阵全景相机检校模型研究[J]. 武汉大学学报(信息科学版), 2014, 39(4):417-421. XU Fang, MEI Wensheng, ZHANG Li. The Calibration Model of Linear Array Panoramic Cameras[J]. Geomatics and Information Science of Wuhan University, 2014, 39(4):417-421.
[7] 李晓辉, 周荫清, 王祖林. 基于曲面拼接的球面全景生成算法[J]. 北京航空航天大学学报, 2007, 33(6):668-671, 681. LI Xiaohui, ZHOU Yinqing, WANG Zulin. Spherical Panorama Creating Algorithm Based on Curve Surface Mosaic[J]. Journal of Beijing University of Aeronautics and Astronautics, 2007, 33(6):668-671, 681.
[8] 龚琪慧, 吴健平, 王洁华, 等. 基于全景图的3维实景制作及其与GIS集成研究[J]. 测绘与空间地理信息, 2012, 35(6):33-37. GONG Qihui, WU Jianping, WANG Jiehua, et al. The Research of the Production of 3D Real Scene and the GIS Integration Thereof Based on Panorama[J]. Geomatics & Spatial Information Technology, 2012, 35(6):33-37.
[9] TONG Guofeng,PANG Xiaolei,YE Ning,et al. A Precise Spherical Camera Model Based on Multi-camera System[J]. Journal of Computational Information Systems, 2013, 9(3):897-905.
[10] BROWN M, LOWE D G. Automatic Panoramic Image Stitching Using Invariant Features[J]. International Journal of Computer Vision, 2007, 74(1):59-73.
[11] 季顺平, 史云. 车载全景相机的影像匹配和光束法平差[J]. 测绘学报, 2013, 42(1):94-100. JI Shunping, SHI Yun. Image Matching and Bundle Adjustment Using Vehicle-based Panoramic Camera[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(1):94-100.
[12] 张正鹏, 江万寿, 张靖. 光流特征聚类的车载全景序列影像匹配方法[J]. 测绘学报, 2014, 43(12):1266-1273.DOI:10.13485/j.cnki.11-2089.2014.0172. ZHANG Zhengpeng, JIANG Wanshou, ZHANG Jing. An Image Match Method Based on Optical Flow Feature Clustering for Vehicle-borne Panoramic Image Sequence[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(12):1266-1273. DOI:10.13485/j.cnki.11-2089.2014.0172.
[13] 刘帅, 陈军, 孙敏, 等. 一种球形立体全景的三维量测算法与实验[J]. 地球信息科学学报, 2014, 16(1):15-22. LIU Shuai, CHEN Jun, SUN Min, et al. A Three Dimensional Measurement Approach and Experiment Based on Spherical Panorama[J]. Journal of Geo-Information Science, 2014, 16(1):15-22.
[14] 刘帅, 陈军, 孙敏, 等. 双球面投影几何可量测全景模型的构建[J]. 计算机辅助设计与图形学学报, 2015, 27(4):657-665. LIU Shuai, CHEN Jun, SUN Min, et al. Measurable Panorama Construction Based on Binocular Spherical Projective Geometry[J]. Journal of Computer-aided Design & Computer Graphics, 2015, 27(4):657-665.
[15] 季顺平, 史云. 高噪声环境下基于参考影像的车载序列影像定位方法[J]. 测绘学报, 2014, 43(11):1174-1181.DOI:10.13485/j.cnki.11-2089.2014.0181. JI Shunping, SHI Yun. Georegistration of Ground Sequential Imagery with Geo-referenced Aerial Images in High Noise Environments[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(11):1174-1181. DOI:10.13485/j.cnki.11-2089.2014.0181.
[16] 季顺平, 史云. 多镜头组合型全景相机两种成像模型的定位精度比较[J]. 测绘学报, 2014, 43(12):1252-1258.DOI:10.13485/j.cnki.11-2089.2014.0169. JI Shunping, SHI Yun. Comparison of Two Sensor Models for Multi-camera Rig System in Measurements[J]. Acta Geodaetica et Cartographica Sinica,2014, 43(12):1252-1258. DOI:10.13485/j.cnki.11-2089.2014.0169.
[17] 石丽梅, 赵红蕊, 李明海, 等. 车载移动测图系统外方位元素标定方法[J]. 测绘学报, 2015, 44(1):52-58.DOI:10.11947/j.AGCS.2015.20130203. SHI Limei, ZHAO Hongrui, LI Minghai, et al. Extrinsic Calibration for Vehicle-based Mobile Mapping System[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(1):52-58. DOI:10.11947/j.AGCS.2015.20130203.
[18] LEPETIT V, MORENO-NOGUER F,FUA P. EPnP:An Accurate O(n) Solution to the PnP Problem[J]. International Journal of Computer Vision, 2009, 81(2):155-166.
[19] HORN B K P, HILDEN H M, NEGAHDARIPOUR S. Closed-form Solution of Absolute Orientation Using Orthonormal Matrices[J]. Journal of the Optical Society of America A, 1988, 5(7):1127-1135.
[20] 王佩军, 徐亚明. 摄影测量学[M]. 武汉:武汉大学出版社, 2005. WANG Peijun, XU Yaming. Photogrammetry[M]. Wuhan:Wuhan University Press, 2005.

Options

文章导航

模态框（Modal）标题

摘要

本文引用格式

Abstract

参考文献