学术论文

光流特征聚类的车载全景序列影像匹配方法

  • 张正鹏 ,
  • 江万寿 ,
  • 张靖
展开
  • 1. 辽宁工程技术大学 测绘与地理科学学院, 辽宁 阜新 123000;
    2. 武汉大学 测绘遥感信息工程国家重点实验室, 湖北 武汉 430079
张正鹏(1981-),男,讲师,博士生,研究方向为车载移动测量技术.zhangzhengpeng2004@126.com

收稿日期: 2013-04-12

  修回日期: 2014-07-09

  网络出版日期: 2014-12-23

基金资助

国家973计划(2012CB719904);国家自然科学基金(41101452);高等学校博士学科点专项科研基金(20122121120003);测绘地理信息公益性行业科研专项(201412007)

An Image Match Method Based on Optical Flow Feature Clustering for Vehicle-borne Panoramic Image Sequence

  • ZHANG Zhengpeng ,
  • JIANG Wanshou ,
  • ZHANG Jing
Expand
  • 1. School of Geomatics, Liaoning Technical University, Fuxin 123000, China;
    2. State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

Received date: 2013-04-12

  Revised date: 2014-07-09

  Online published: 2014-12-23

摘要

提出一种光流特征聚类的车载全景序列影像匹配方法.采用非参数化的均值漂移特征聚类思想,以SIFT多尺度特征匹配点的位置量和光流矢量,构建了影像特征空间的空域和值域;利用特征空间中对应的显著图像光流特征为聚类条件,实现了全景序列影像的匹配;最后以全景极线几何约束为条件进行粗差的剔除.通过相同、不同内点率以及不同数据的试验对比分析,本文方法在匹配正确点数和正确率方面要优于经典的Ransac法和金字塔Lucas-Kanade光流法,尤其在场景复杂造成的低内点率情况下,算法表现较为稳定,并可较好地剔除由重复纹理、运动物体、尺度变化等产生的匹配点粗差.

本文引用格式

张正鹏 , 江万寿 , 张靖 . 光流特征聚类的车载全景序列影像匹配方法[J]. 测绘学报, 2014 , 43(12) : 1266 -1273 . DOI: 10.13485/j.cnki.11-2089.2014.0172

Abstract

An image match method based on optical flow feature clustering is presented for vehicle-borne panoramic image sequence. The spatial domain and range domain of image feature space are built by the coordinates of SIFT multi-scale feature matching point and optical flow vector, then the panoramic image match is finished by Mean Shift attached to the optical flow clustering constraint condition in image feature space. Finally, panoramic geometric constraint of Ransac method is used for gross error detection. Several panoramic images are selected and used for experiment. The experiments of analysis and comparison were carried out in the conditions of the same inlier ratio, different inlier ratio and different data. The results show that the proposed method in the number and accuracy of correct matching points are superior to classic Ransac method and Pyramid Lucas-Kanade method, especially in the complex scene in low inlier ratio cases, the algorithm performance is relatively stable, and have better constraint effect for the gross error usually caused by repeat texture, moving objects and scale change.

参考文献

[1] KANGNI F, LAGANIERE R. Epipolar Geometry for the Rectification of Cubic Panoramas[C]//Proceedings of the 3rd Canadian Conference on Computer and Robot Vision. Halifax: IEEE, 2006, 70-70.
[2] LOWE D G. Distinctive Image Features from Scale-invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110.
[3] NISTR D. An Efficient Solution to the Five-point Relative Pose Problem [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(6): 756-770.
[4] FISCHLER M A, BOLLES R C. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography[J].Communications of the ACM, 1981, 24(6): 381-395.
[5] HARTLEY R, ZISSERMAN A. Multiple View Geometry in Computer Vision[M]. 2nd ed. Cambridge: Cambridge University Press, 2003.
[6] JIANG Wanshou, ZHENG Shunyi, ZHANG Zuxun, et al. Feature-based Image Matching for Aerial Images[J]. Geomatics and Information Science of Wuhan University, 2003, 28(5): 510-513. (江万寿, 郑顺义, 张祖勋, 等. 航空影像特征匹配研究[J]. 武汉大学学报: 信息科学版, 2003, 28(5): 510-513.)
[7] LI Xiaoming, ZHENG Lian, HU Zhanyi. SIFT Based Automatic Registration of Remotely-sensed Imagery[J]. Journal of Remote Sensing, 2006, 10(6): 885-892. (李晓明, 郑链, 胡占义. 基于SIFT特征的遥感影像自动配准[J]. 遥感学报, 2006, 10(6): 885-892.)
[8] LIANG Dong, TONG Qiang, QU Lei, et al. Algorithm for Images Matching Based on Epipolar and Homography Constraints[J]. Journal of System Simulation, 2006, 18(1): 44-46. (梁栋, 童强, 屈磊, 等. 一种基于极几何和单应约束的图像匹配算法[J]. 系统仿真学报, 2006, 18(1): 44-46.)
[9] LV Jinjian, WEN Gongjian, LI Deren, et al. A New Method Based on Spatial Relations for Feature Matching [J]. Acta Geodaetica et Cartographica Sinica, 2008, 37(3), 367-373. (吕金建, 文贡坚, 李德仁, 等. 一种新的基于空间关系的特征匹配方法[J]. 测绘学报, 2008, 37(3), 367-373.)
[10] ZHANG Ka, SHENG Yehua, YE Chun. Digital Close-range Stereo Image Matching Based on Digital Parallax Model and Improved SIFT Feature[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(6): 624-630. (张卡, 盛业华, 叶春. 基于数字视差模型和改进SIFT特征的数字近景立体影像匹配[J]. 测绘学报, 2010, 39(6): 624-630.)
[11] ZHAO Xian, CHEN Zhixue, LV Jingguo, et al. The Scale and Rotating Invariant Auto Stereo Matching[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(1): 81-86. (赵西安, 陈志学, 吕京国,等. 具有尺度与旋转不变性的立体影像自动匹配研究[J]. 测绘学报, 2012, 41(1): 81-86.)
[12] SATO T, PAJDLA T, YOKOYA N. Epipolar Geometry Estimation for Wide-baseline Omnidirectional Street View Images[C]//Proceedings of 2011 IEEE International Conference on Computer Vision Workshops. Barcelona: IEEE, 2011: 56-63.
[13] NI K, JIN H L, DELLAERT F. GroupSAC: Efficient Consensus in the Presence of Groupings [C]//Proceedings of IEEE 12th International Conference on Computer Vision. Kyoto: IEEE, 2009: 2193-2200.
[14] MICUSIK B, KOSECKA J. Piecewise Planar City 3D Modeling from Street View Panoramic Sequences[C]//Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami: IEEE, 2009: 2906-2912.
[15] BOUGUET J Y. Pyramidal Implementation of the Lucas Kanade Feature Tracker: Description of the Algorithm[R].California:Intel Corporation Microprocessor Research Labs,2002.
[16] SUN D, ROTH S, BLACK M J, et al. Secrets of Optical Flow Estimation and Their Principles[C]//Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco: IEEE, 2010: 2432-2439.
[17] FUKUNAGA K, HOSTETLER L. The Estimation of the Gradient of a Density Function, with Applications in Pattern Recognition[J]. IEEE Transactions on Information Theory, 1975, 21(1): 32-40.
[18] COMANICIU D, MEER P. Mean Shift: A Robust Approach toward Feature Space Analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5): 603-619.
[19] CHRISTOUDIAS C M, GEORGESCU B, MEER P. Synergism in Low Level Vision[C]//Proceedings of 16th International Conference on Pattern Recognition. Quebec: [s.n.], 2002: 150-155.
[20] TANG Jin. Omnidirectional Image Based on IBR[D]. Changsha: Central South University, 2002. (唐琎. 基于IBR的全方位全景图像[D]. 长沙: 中南大学, 2002.)
文章导航

/