An iterative and adaptive registration method for multi-beam and side-scan sonar images

doi:10.11947/j.AGCS.2022.20210023

Abstract

Abstract: Aiming at the problem that the current multi-beam and side-scan sonar image registration methods fail to take into account the details of image deformation, the scale differences and exist local texture distortion, a iterative adaptive registration method combining wavelet transform, affine transform and Demons registration algorithm was proposed. By using wavelet transformation to extract the low frequency information from side scan sonar image and reconstruction images, using affine transformation and Demons algorithm to reconstruct image with iterative adaptive multi-beam image registration, obtain registration transformation model. The model is used to transform the original side-scan sonar image to obtain the side-scan sonar image constrained by the geographic coordinates of the multi-beam image. The results of example verification show that this method can effectively realize the registration of multi-beam and side-scan sonar images, and obtain the fusion sonar images with accurate position and rich texture.

Key words: multi-beam sonar image, side-scan sonar image, image registration, wavelet transformation, affine transformation, Demons algorithm

CLC Number:

P229

ZHANG Ning, JIN Shaohua, BIAN Gang, XIAO Fumin. An iterative and adaptive registration method for multi-beam and side-scan sonar images[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(9): 1951-1958.

References

[1] ZHANG Lihua, LIU Xianpeng, JIA Shuaidong, et al. A line-surface integrated algorithm for underwater terrain matching[J]. Journal of Geodesy and Geoinformation Science, 2019, 2(4):10-20.
[2] ZITOVÁ B, FLUSSER J. Image registration methods:a survey[J]. Image and Vision Computing, 2003, 21(11):977-1000.
[3] 余先川, 吕中华, 胡丹. 遥感图像配准技术综述[J]. 光学精密工程, 2013, 21(11):2960-2972. YU Xianchuan, LÜ Zhonghua, HU Dan. Review of remote sensing image registration techniques[J]. Optics and Precision Engineering, 2013, 21(11):2960-2972.
[4] 赵建虎, 王爱学, 郭军. 多波束与侧扫声呐图像区块信息融合方法研究[J]. 武汉大学学报(信息科学版), 2013(3):287-290. ZHAO Jianhu, WANG Aixue, GUO Jun. Study on fusion method of the block image of MBS and SSS[J]. Geomatics and Information Science of Wuhan University, 2013(3):287-290.
[5] 侯雪, 周兴华, 唐秋华, 等. 基于SURF算法的多波束和侧扫声纳图像配准与融合[J]. 海洋通报, 2016, 35(1):38-45. HOU Xue, ZHOU Xinghua, TANG Qiuhua, et al. Registration and fusion of multi-beam echo sounder and side scan sonar image based on the revised SURF method[J]. Marine Science Bulletin, 2016, 35(1):38-45.
[6] 欧阳壮志, 欧阳明达. 多波束图像与侧扫声纳图像的配准及融合[J]. 测绘技术装备, 2013, 15(3):28-31. OUYANG Zhuangzhi, OUYANG Mingda. Registration and fusion of multi-beam image and side-scan sonar image[J]. Geomatics Technology and Equipment, 2013, 15(3):28-31.
[7] 阳凡林, 吴自银, 独知行, 等. 多波束声纳和侧扫声纳数字信息的配准及融合[J]. 武汉大学学报(信息科学版), 2006, 31(8):740-743. YANG Fanlin, WU Ziyin, DU Zhixing, et al. Co-registering and fusion of digital information of multi-beam sonar and side-scan sonar[J]. Geomatics and Information Science of Wuhan University, 2006, 31(8):740-743.
[8] LE BAS T P. An analytical correlation and comparison of high resolution side-scan sonar imagery and multi-beam bathymetry[C]//Proceedings of the 1995 IEEE Colloquium on Recent Developments in Radar and Sonar Imaging Systems:What Next? London, UK:IET, 1995.
[9] DANIEL S, LE LEANNEC F, ROUX C, et al. Side-scan sonar image matching[J]. IEEE Journal of Oceanic Engineering, 1998, 23(3):245-259.
[10] 王达, 卞红雨. 水下声图像多分辨率融合研究[J]. 武汉大学学报(信息科学版), 2015, 40(1):77-82. WANG Da, BIAN Hongyu. Underwater acoustic image multi-resolution fusion research[J]. Geomatics and Information Science of Wuhan University, 2015, 40(1):77-82.
[11] THIRION J P. Image matching as a diffusion process:an analogy with Maxwell's demons[J]. Medical Image Analysis, 1998, 2(3):243-260.
[12] WANG He, DONG Lei, O' DANIEL J, et al. Validation of an accelerated 'demons' algorithm for deformable image registration in radiation therapy[J]. Physics in Medicine and Biology, 2005, 50(12):2887-2905.
[13] 王达. 声纳图像配准与融合技术研究[D]. 哈尔滨:哈尔滨工程大学, 2014. WANG Da. Sonar image registration and fusion technology research[D]. Harbin:Harbin Engineering University, 2014.
[14] 许亚军, 陈小惠. 一种基于遗传算法和小波分解的刚性图像配准方法[J]. 江苏科技大学学报(自然科学版), 2008, 22(2):75-78. XU Yajun, CHEN Xiaohui. A rigid image registration method based on genetic algorithm and wavelet decomposition[J]. Journal of Jiangsu University of Science and Technology (Natural Science Edition), 2008, 22(2):75-78.
[15] 赵丽, 王玉兰, 张孝攀. 基于小波变换的图像处理技术研究[J]. 四川理工学院学报(自然科学版), 2013, 26(6):37-40. ZHAO Li, WANG Yulan, ZHANG Xiaopan. Image processing technique research based on wavelet transform[J]. Journal of Sichuan University of Science & Engineering (Natural Science Edition), 2013, 26(6):37-40.
[16] KELLER Y, AVERBUCH A. Multisensor image registration via implicit similarity[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(5):794-801.
[17] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[18] 陈潇, 邢立新, 高志勇, 等. 基于小波变换的遥感影像纹理信息提取[J]. 安徽农业科学, 2015, 43(4):363-366. CHEN Xiao, XING Lixin, GAO Zhiyong, et al. Information extraction of remote sensing image texture based on wavelet transform[J]. Journal of Anhui Agricultural Sciences, 2015, 43(4):363-366.
[19] 王达, 卞红雨. 声纳图像配准中的Demons算法[J]. 中南大学学报(自然科学版), 2013, 44(10):4074-4080. WANG Da, BIAN Hongyu. A variational Demons algorithm on sonar image registration[J]. Journal of Central South University (Science and Technology), 2013, 44(10):4074-4080.
[20] 杨应, 林宗坚. 全部像元参加的影像几何匹配算法[J]. 测绘学报, 2017, 46(5):573-582.DOI:10.11947/j.AGCS.2017.20160368. YANG Ying, LIN Zongjian. All-pixels participated image matching algorithm for geometric solution[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(5):573-582. DOI:10.11947/j.AGCS.2017.20160368.
[21] 曾文锋, 李树山, 王江安. 基于仿射变换模型的图像配准中的平移、旋转和缩放[J]. 红外与激光工程, 2001, 30(1):18-20, 17. ZENG Wenfeng, LI Shushan, WANG Jiangan. Translation, rotation and scaling changes in image registration based affine transformation model[J]. Infrared and Laser Engineering, 2001, 30(1):18-20, 17.
[22] 赵建虎, 严俊, 张红梅, 等. 基于海底底质回波特征的多波束声呐图像角度响应影响消除[J]. 武汉大学学报(信息科学版), 2018, 43(8):1228-1233, 1286. ZHAO Jianhu, YAN Jun, ZHANG Hongmei, et al. Using backscatter characteristic of seabed sediment to remove angular response effect in multibeam images[J]. Geomatics and Information Science of Wuhan University, 2018, 43(8):1228-1233, 1286.
[23] 库安邦, 周兴华, 李冠泽. 不同型号侧扫声呐分辨能力和扫宽能力的比较分析[J]. 测绘与空间地理信息, 2018, 41(1):68-70, 73. KU Anbang, ZHOU Xinghua, LI Guanze. Comparison and analysis of different types of side scan sonar's detection and scan width ability[J]. Geomatics & Spatial Information Technology, 2018, 41(1):68-70, 73.
[24] 朱小辰, 刘雁春, 肖付民, 等. 多波束测深全覆盖测量分辨率研究[J]. 测绘科学, 2010, 35(S1):22-24. ZHU Xiaochen, LIU Yanchun, XIAO Fumin, et al. Full coverage resolution research of multibeam echo sounding[J]. Science of Surveying and Mapping, 2010, 35(S1):22-24.
[25] 彭曙蓉, 王耀南, 刘国才. 基于边缘提取和改进型整体松弛匹配算法的InSAR复图像配准方法[J]. 测绘学报, 2007, 36(1):62-66, 77. PENG Shurong, WANG Yaonan, LIU Guocai. A method improving registration accuracy progressively for InSAR complex image[J]. Acta Geodaetica et Cartographica Sinica, 2007, 36(1):62-66, 77.
[26] 宋树军, 侯雪, 唐秋华. 基于互信息和相关比算法的声呐图像配准[J]. 海岸工程, 2015, 34(4):69-76. SONG Shujun, HOU Xue, TANG Qiuhua. A sonar image registration algorithm based on both mutual information and correlation ratio[J]. Coastal Engineering, 2015, 34(4):69-76.