UAV Image Registration Algorithm Using Color Invariant and AKAZE Feature

doi:10.11947/j.AGCS.2017.20160436

Abstract

Abstract: Image matching based on feature was one of practical methods in UAV image matching. Since the conventional methods of image registration mainly used gray image as input that it could not take color features into account to distinguish the identical point. To address this problem, this paper designed a matching algorithm combined color invariant with AKAZE feature, which overcame the shortcoming of ignoring color information in traditional UAV image matching. Then gray level transformation was utilized to reduce the number of feature points and remain its reliability. Experimental results demonstrate that the proposed method can find the identical point accurately and enhance the efficiency.

Key words: UAV image, color invariant, AKAZE feature extraction algorithm, gray level transformation, image matching

CLC Number:

P237

LIANG Huanqing, XIE Yi, FU Sizhou. UAV Image Registration Algorithm Using Color Invariant and AKAZE Feature[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(7): 900-909.

References

[1] 刘有. 无人机序列影像匹配及拼接方法研究[D]. 长沙: 中南大学, 2012. LIU You. Research on Matching and Mosaicing Methods for UAV Image Sequences[D]. Changsha: Central South University, 2012.
[2] 王勃. 基于特征的无人机影像自动拼接技术研究[D]. 郑州: 信息工程大学, 2011. WANG Bo. Automatic Mosaic Technique of UAV Images Based on Features[D]. Zhengzhou: Information Engineering University, 2011.
[3] 吕金建, 文贡坚, 李德仁, 等. 一种新的基于空间关系的特征匹配方法[J]. 测绘学报, 2008, 37(3): 367-373. LV Jinjian, WEN Gongjian, LI Deren, et al. A New Method Based on Spatial Relations for Feature Matching[J]. Acta Geodaetica et Cartographica Sinica, 2008, 37(3): 367-373.
[4] LOWE D G. Object Recognition from Local Scale-invariant Features[C]//Proceedings of the Seventh IEEE International Conference on Computer Vision. Kerkyra: IEEE, 1999, 2: 1150-1157.
[5] WITKIN A P. Scale-space Filtering[M]//FISCHLER M A, FIRSCHEIN O. Readings in Computer Vision: Issues, Problem, Principles, and Paradigms. Los Altos, CA: Morgan Kaufmann, 1987: 329-332.
[6] 张卡, 盛业华, 叶春. 基于数字视差模型和改进SIFT特征的数字近景立体影像匹配[J]. 测绘学报, 2010, 39(6): 624-630. ZHANG Ka, SHENG Yehua, YE Chun. Digital Close Range Stereo Image Matching Based on Digital Parallax Model and Improved SIFT Feature[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(6): 624-630.
[7] 岳春宇, 江万寿. 几何约束和改进SIFT的SAR影像和光学影像自动配准方法[J]. 测绘学报, 2012, 41(4): 570-576. YUE Chunyu, JIANG Wanshou. An Automatic Registration Algorithm for SAR and Optical Images Based on Geometry Constraint and Improved SIFT[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(4): 570-576.
[8] ZHENG Mingguo, WU Chengdong, CHEN Dongyue. UAV Image Identification in Urban Region Satellite Image Using Global Feature and Local Feature[C]//Proceedings of the 2016 Chinese Control and Decision Conference (CCDC). Yinchuan: IEEE, 2016: 5377-5382.
[9] 贾丰蔓, 康志忠, 于鹏. 影像同名点匹配的SIFT算法与贝叶斯抽样一致性检验[J]. 测绘学报, 2013, 42(6): 877-883. JIA Fengman, KANG Zhizhong, YU Peng. A SIFT and Bayes Sampling Consensus Method for Image Matching[J]. Acta Geodaetica et Cartographica Sinica, 2013, 42(6): 877-883.
[10] AGRAWAL M, KONOLIGE K, RUFUS BLAS M. CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching[C]//Proceedings of the 2008 European Conference on Computer Vision. Marseille: Springe, 2008: 102-115.
[11] LI Qiaoliang, WANG Guoyou, LIU Jianguo, et al. Robust Scale-invariant Feature Matching for Remote Sensing Image Registration[J]. IEEE Geoscience and Remote Sensing Letters, 2009, 6(2): 287-291.
[12] ROSTEN E, PORTER R, DRUMMOND T. Faster and Better: A Machine Learning Approach to Corner Detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(1): 105-119.
[13] ROSTEN E, DRUMMOND T. Machine Learning for High-speed Corner Detection[C]//Proceedings of the 9th European Conference on Computer Vision. Graz: Springer, 2006: 430-443.
[14] CALONDER M, LEPETIT V, STRECHA C, et al. BRIEF: Binary Robust Independent Elementary Features[C]//Proceedings of the 11th European Conference on Computer Vision. Heraklion: Springer, 2010: 778-792.
[15] LEUTENEGGER S, CHLI M, SIEGWART R Y. BRISK: Binary Robust Invariant Scalable Keypoints[C]//Proceedings of 2011 IEEE International Conference on Computer Vision. Barcelona, Spain: IEEE, 2011: 2548-2555.
[16] MAIR E, HAGER G D, BURSCHKA D, et al. Adaptive and Generic Corner Detection Based on the Accelerated Segment Test[C]//Proceedings of the 11th European Conference on Computer Vision. Heraklion: Springer, 2010: 183-196.
[17] ALCANTARILLA P F, NUEVO J, BARTOLI A. Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces[C]//British Machine Vision Conference (BMVC). Bristol: British Machine Vision Association, 2013: 13.1-13.11.
[18] GREWENIG S, WEICKERT J, BRUHN A. From Box Filtering to Fast Explicit Diffusion[C]//Proceedings of the 32th DAGM Conference on Pattern Recognition. Darmstadt: Springer-Verlag, 2010: 533-542.
[19] WEICKERT J, GREWENIG S, SCHROERS C, et al. Cyclic Schemes for PDE-Based Image Analysis[J]. International Journal of Computer Vision, 2016, 118(3): 275-299.
[20] JING Huiyun, HE Xin, HAN Qi, et al. CBRISK: Colored Binary Robust Invariant Scalable Keypoints[J]. IEICE Transactions on Information and Systems, 2013, E96(2): 392-395.
[21] GEUSEBROEK J M, VAN DEN BOOMGAARD R, SME-ULDERS A W M, et al. Color Invariance[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(12): 1338-1350.
[22] ABDEL-HAKIM A E, FARAG A A. CSIFT: A SIFT Descriptor with Color Invariant Characteristics[C]//Proceedings of 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2006: 1978-1983.
[23] 刘景正. 无人飞行器影像场景配准与目标监视技术研究[D]. 郑州: 信息工程大学, 2011. LIU Jingzheng. Research on Techniques in Scene Registration and Object Surveillance for UAV Imagery[D]. Zhengzhou: Information Engineering University, 2011.
[24] 宋丽华. 基于无人飞行器序列影像的定位技术研究[D]. 郑州: 信息工程大学, 2010. SONG Lihua. The Study of Target Positioning Technology Based on UAV Image Sequence[D]. Zhengzhou: Information Engineering University, 2010.
[25] 牛俊伟, 郝向阳, 刘松林. 一种改进的SIFT特征提取算法[J]. 测绘科学技术学报, 2014, 31(2): 173-176. NIU Junwei, HAO Xiangyang, LIU Songlin. An Improved SIFT Feature Extraction Algorithm[J]. Journal of Geomatics Science and Technology, 2014, 31(2): 173-176.
[26] 梁焕青, 范永弘, 万惠琼, 等. 一种运用AKAZE特征的无人机遥感影像拼接方法[J] 测绘科学技术学报, 2016, 33(1): 71-75. LIANG Huanqing, FAN Yonghong, WAN Huiqiong, et al. Mosaic Algorithm of UAV Images Based on AKAZE Features[J]. Journal of Geomatics Science and Technology, 2016, 33(1): 71-75.