多尺度细节增强的遥感影像超分辨率重建

doi:10.11947/j.AGCS.2016.20150451

测绘学报 ›› 2016, Vol. 45 ›› Issue (9): 1081-1088.doi: 10.11947/j.AGCS.2016.20150451

多尺度细节增强的遥感影像超分辨率重建

朱红^1,2, 宋伟东¹, 谭海², 王竞雪¹

1. 辽宁工程技术大学测绘与地理科学学院, 辽宁阜新 123000;
2. 国家测绘地理信息局卫星测绘应用中心, 北京 100048

收稿日期:2015-09-06 修回日期:2016-03-20 出版日期:2016-09-20 发布日期:2016-09-29
通讯作者: 宋伟东 E-mail:lntu_swd@163.com
作者简介:朱红(1989-),女,博士生,研究方向为遥感影像超分辨率重建、影像匹配等.E-mail:zhuhong19890408@163.com
基金资助:
测绘地理信息公益性行业科研专项（201412007）；辽宁省科技博士启动基金（20141142）

Remote Sensing Images Super Resolution Reconstruction Based on Multi-scale Detail Enhancement

ZHU Hong^1,2, SONG Weidong¹, TAN Hai², WANG Jingxue¹

1. School of Geomatics, Liaoning Technical University, Fuxin 123000, China;
2. Satellite Surveying and Mapping Application Center of NASG, Beijing 100048, China

Received:2015-09-06 Revised:2016-03-20 Online:2016-09-20 Published:2016-09-29
Supported by:
The Public Welfare Industry Scientific Research Based on Surveying and Mapping Geographic Information(NO.201412007);The Natural Science Foundation of Dr. Initial Funding of Liaoning Province(No.20141142)

摘要/Abstract

摘要： 鉴于现有超分辨率重建方法难以突显重建影像细节信息的问题，提出多尺度细节增强的遥感影像超分辨率重建模型框架。首先，通过最小二乘滤波方法将序列影像分解成包含大尺度边缘的平滑信息和包含中小型尺度的细节信息；其次，利用插值方法得到相应的高分辨率细节信息和平滑信息，构造纹理细节增强函数，提升中小型细节的增强幅度；最终，融合细节信息和平滑信息，得到初始的超分辨率重建结果，并利用局部优化模型进一步改善重建影像质量。选取同时相和多时相遥感影像作为试验数据。试验结果表明，本文重建结果与插值方法、TV方法和MAP方法相比，在客观评价指标上均有显著提高，明显改善了重建影像的纹理细节。论文提出的多尺度细节增强的超分辨率重建方法，可以使重建影像提供更多高频细节信息，具有较好鲁棒性和普适性。

关键词: 超分辨率重建, 细节增强, 多尺度分解, 最小二乘滤波

Abstract: The existing methods are hard to highlight the details after super resolution reconstruction, so it is proposed a super-resolution model frame to enhance the multi-scale details. Firstly, the sequence images are multi-scale deposed to keep the edge structure and the deposed multi-scale image information are differenced. Then, the smoothing information and detail information are interpolated, and a texture detail enhancement function is built to improve the scope of small details. Finally, the coarse-scale image information and small-medium-scale information are confused to get the premier super-resolution reconstruction result, and a local optimizing model is built to further promote the premier image quality. The experiments on the same period and different period remote sensing images show that the objective evaluation index are both largely improved comparing with the interpolation method, traditional total variation(TV)method,and maximum a posterior(MAP) method. The details of the reconstruction image are improved distinctly. The reconstruction image produced using the proposed method provides more high frequency details, and the method proves to be robust and universal for different kinds of satellite remote sensing images.

Key words: super resolution reconstruction, detail enhancement, multi-scale decomposition, image fusion

中图分类号:

P236

朱红, 宋伟东, 谭海, 王竞雪. 多尺度细节增强的遥感影像超分辨率重建[J]. 测绘学报, 2016, 45(9): 1081-1088.

ZHU Hong, SONG Weidong, TAN Hai, WANG Jingxue. Remote Sensing Images Super Resolution Reconstruction Based on Multi-scale Detail Enhancement[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(9): 1081-1088.

参考文献

[1] 钟九生, 江南, 胡斌, 等. 一种遥感影像超分辨率重建的稀疏表示建模及算法[J]. 测绘学报, 2014, 43(3): 276-283. DOI:10.13485/j.cnki.11-2089.2014.0040. ZHONG Jiusheng, JIANG Nan, HU Bin, et al. A Super-resolution Model and Algorithm of Remote Sensing Image Based on Sparse Representation[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(3): 276-283. DOI:10.13485/j.cnki.11-2089.2014.0040.
[2] ZHANG Kaibing, TAO Dacheng, GAO Xinbo, et al. Learning Multiple Linear Mappings for Efficient Single Image Super-resolution[J]. IEEE Transactions on Image Processing, 2015, 24(3): 846-861.
[3] 谭兵, 徐青, 邢帅, 等. 小波超分辨率重建算法及其在SPOT影像中的应用[J]. 测绘学报, 2004, 33(3): 233-238. TAN Bing, XU Qing, XING Shuai, et al. Wavelet Super-resolution Algorithm and Its Application to SPOT Images[J]. Acta Geodaetica et Cartographica Sinica, 2004, 33(3): 233-238.
[4] WANG Shenlong, ZHANG Lei, LIANG Yan, et al. Semi-coupled Dictionary Learning with Applications to Image Super-resolution and Photo-sketch Synthesis[C]//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI: IEEE, 2012: 2216-2223.
[5] COSSAIRT O, GUPTA M, NAYAR S K. When Does Computational Imaging Improve Performance[J]. IEEE Transactions on Image Processing, 2013, 22(2): 447-458.
[6] YANG J, LIN Z, COHEN S. Fast Image Super-resolution Based on In-place Example Regression[C]//IEEE Conference on Computer Vision & Pattern Recognition. [S. l.]: IEEE, 2013:1059-1066.
[7] YANG Jianchao, WRIGHT J, HUANG T S, et al. Image Super-resolution via Sparse Representation[J]. IEEE Transactions on Image Processing, 2010, 19(11): 2861-2873.
[8] 钦桂勤, 耿则勋, 徐青. 利用频谱解混叠方法实现超分辨率影像重建[J]. 测绘学报, 2003, 32(2): 143-147. QIN Guiqin, GENG Zexun, XU Qing. Super-resolution Image Restoration by Spectral Dealiasing[J]. Acta Geodaetica et Cartographica Sinica, 2003, 32(2): 143-147.
[9] DOGIWAL S R, SHISHODIA Y S, UPADHYAYA A. Super Resolution Image Reconstruction Using Wavelet Lifting Schemes and Gabor Filters[C]//Proceedings of the 5th International Conference:Confluence the Next Generation Information Technologuser Summit. Noida: IEEE, 2014: 625-630.
[10] BABU P A,PRASAD K V S V R.Binary Plane Technique for Super Resolution Image Reconstruction Using Integer Wavelet Transform[C]//Proceedings of 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering. Salem: IEEE, 2013: 237-240.
[11] ZHANG Lei, WU Xiaolin. An Edge-guided Image Interpolation Algorithm via Directional Filtering and Data Fusion[J]. IEEE Transactions on Image Processing, 2006, 15(8): 2226-2238.
[12] 沈焕锋, 李平湘, 张良培. 一种顾及影像纹理特性的自适应分辨率增强算法[J]. 遥感学报, 2005, 9(3): 253-259. SHEN Huanfeng, LI Pingxiang, ZHANG Liangpei. An Adaptive Algorithm for Resolution Enhancement Considering the Texture Attribute of Images[J]. Journal of Remote Sensing, 2005, 9(3): 253-259.
[13] 周登文, 申晓留. 边导向的双三次彩色图像插值[J]. 自动化学报, 2012, 38(4): 525-530. ZHOU Dengwen, SHEN Xiaoliu. Edge-directed Bicubic Color Image Interpolation[J]. Acta Automatica Sinica, 2012, 38(4): 525-530.
[14] PARK M K, KANG M G, KATSAGGELOS A K. Regularized High-resolution Image Reconstruction Considering Inaccurate Motion Information[J]. Optical Engineering, 2007, 46(11): 117004.
[15] FADILI J M, PEYRE G. Total Variation Projection with First Order Schemes[J]. IEEE Transactions on Image Processing, 2011, 20(3): 657-669.
[16] LIU Ce, SUN Deqing. On Bayesian Adaptive Video Super Resolution[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(2): 346-360.
[17] FATTAL R, AGRAWALA M, RUSINKIEWICZ S. Multiscale Shape and Detail Enhancement from Multi-light Image Collections[J]. ACM Transactions on Graphics, 2007, 26(3): 51.
[18] VILLENA S, VEGA M, BABACAN S D, et al. Bayesian Combination of Sparse and Non-sparse Priors in Image Super Resolution[J]. Digital Signal Processing, 2013, 23(2): 530-541.
[19] 肖创柏, 禹晶, 薛毅. 一种基于MAP的超分辨率图像重建的快速算法[J]. 计算机研究与发展, 2009, 46(5): 872-880. XIAO Chuangbai, YU Jing, XUE Yi. A Novel Fast Algorithm for MAP Super-resolution Image Reconstruction[J]. Journal of Computer Research and Development, 2009, 46(5): 872-880.
[20] 沈焕锋, 李平湘, 张良培. 一种自适应正则MAP超分辨率重建方法[J]. 武汉大学学报(信息科学版), 2006, 31(11): 949-952. SHEN Huanfeng, LI Pingxiang, ZHANG Liangpei. Adaptive Regularized MAP Super-resolution Reconstruction Method[J]. Geomatics and Information Science of Wuhan University, 2006, 31(11): 949-952.
[21] FATTAL R, AGRAWALA M, RUSINKIEWICZ S. Multiscale Shape and Detail Enhancement from Multi-light Image Collections[J]. ACM Transactions on Graphics, 2007, 26(3): 51-59.
[22] 李弼程,魏俊,彭天强.遥感影像融合效果的客观分析与评价[J].计算机工程与科学, 2004, 26(1): 42-46. LI Bicheng, WEI Jun, PENG Tianqiang. Objective Analysis and Evaluation of Remote Sensing Image Fusion Effect[J]. Computer Engineering & Science, 2004, 26(1): 42-46.
[23] AGAIAN S S,PANETTA K A, GRIGORYAN A. Transform-based Image Enhancement Algorithms with Performance Measure[J]. IEEE Transactions on Image Processing, 2001, 10(3):367-382.
[24] AGAIAN S S, SILVER B,PANETTA K. A. Transform Coefficient Histogram-based Image Enhancement Algorithms Using Contrast Entropy[J]. IEEE Transactions on ImageProcessing, 2007, 16(3): 741-758.

多尺度细节增强的遥感影像超分辨率重建

Remote Sensing Images Super Resolution Reconstruction Based on Multi-scale Detail Enhancement

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	卜丽静, 郑新杰, 张正鹏. 顾及运动估计误差的“凝视”卫星视频运动场景超分辨率重建[J]. 测绘学报, 2020, 49(2): 214-224.
[2]	钟九生江南胡斌胡秋翔. 一种遥感影像超分辨率重建的稀疏表示建模及算法[J]. 测绘学报, 2014, 43(3): 276-283.