顾及运动估计误差的“凝视”卫星视频运动场景超分辨率重建

doi:10.11947/j.AGCS.2020.20180544

测绘学报 ›› 2020, Vol. 49 ›› Issue (2): 214-224.doi: 10.11947/j.AGCS.2020.20180544

顾及运动估计误差的“凝视”卫星视频运动场景超分辨率重建

卜丽静¹, 郑新杰², 张正鹏¹

1. 辽宁工程技术大学测绘与地理科学学院, 辽宁阜新 123000;
2. 黑龙江地理信息工程院, 黑龙江哈尔滨 150081

收稿日期:2018-11-26 修回日期:2019-08-29 发布日期:2020-03-03
作者简介:卜丽静(1980-),女,博士,副教授,研究方向为遥感图像超分辨率重建和复原。E-mail:lijingbu@126.com
基金资助:
国家自然科学基金青年科学基金项目（41801294）；武汉大学测绘遥感信息工程国家重点实验室特别开放基金资助（18T07）；辽宁省自然科学基金项目（20180551209）

Super-resolution reconstruction of “straring” satellite video motion scene considering motion estimation error

BU Lijing¹, ZHENG Xinjie², ZHANG Zhengpeng¹

1. School of Geomatics, Liaoning Technical University, Fuxin 123000, China;
2. Heilongjiang Geographic Information Engineering Institute, Harbin 150081, China

Received:2018-11-26 Revised:2019-08-29 Published:2020-03-03
Supported by:
The National Natural Science Foundation of China(No. 41801294);Open Research Fund of State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(No. 18T07);The Natural Science Fund of Liaoning Province(No. 20180551209)

摘要/Abstract

摘要： 在含有运动地物的"凝视"卫星视频影像超分辨率重建问题中，针对由于运动估计不准确导致的重建后运动物体存在"格网"和"拖尾"等问题，提出了顾及运动估计误差的运动场景超分辨率重建方法。首先，在MAP模型框架下分析了基于L₁范数和L₂范数的保真项对于运动估计误差的稳健性，引入稳健的M-估计作为保真项，自适应的减少运动估计误差对重建结果的影响；然后，分析了稳健估计条件下Tikhonov、TV、BTV正则项的重建效果；最后，提出了基于稳健估计的双边滤波超分辨率重建方法，用SkyBox和吉林一号的卫星视频数据验证本文方法。试验证明，本文方法对含有运动目标的卫星视频影像具有较好的重建效果，重建后动态和静态地物细节都得到提升，归一化方差和梯度能量指标都优于其他方法。试验表明了本文方法的可行性。

关键词: 卫星视频, 超分辨率重建, 运动估计, 稳健估计

Abstract: In the application of super-resolution reconstruction of staring satellite video image, due to inaccurate motion estimation, the reconstructed moving objects will appear "Grid" And "Tailing". in this paper, a motion scene super-resolution reconstruction method considering motion estimation error is proposed. The sensitivity of the regularized model expressed by L1 and L2 norms to noise is analyzed under the condition of motion estimation error.In this paper, robust estimation method is introduced to express the fidelity term of regularized model, so as to reduce the influence of motion estimation errors on the reconstructed results. On the basis of robust estimation model, tikhonov, TV and BTV regular terms are added respectively, and the super-resolution reconstruction effect of each model is analyzed. A bilateral filtering super-resolution reconstruction method based on robust estimation is proposed. The experiment chooses skybox and jilin-1 satellite video data. The results show that the method proposed in this paper is effective in reconstructing moving objects,and the details of the ground objects are clearer. In terms of normalized difference and gradient energy evaluation index, this method is superior to the classical method.

Key words: satellite video, super-resolution reconstruction, motion estimate, robust estimation

中图分类号:

P237

卜丽静, 郑新杰, 张正鹏. 顾及运动估计误差的“凝视”卫星视频运动场景超分辨率重建[J]. 测绘学报, 2020, 49(2): 214-224.

BU Lijing, ZHENG Xinjie, ZHANG Zhengpeng. Super-resolution reconstruction of “straring” satellite video motion scene considering motion estimation error[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(2): 214-224.

参考文献

[1] 杨秀彬, 林星辰. 低轨凝视卫星动态跟踪对成像的影响分析[J]. 红外与激光工程, 2014, 43(S1):203-208. YANG Xiubin, LIN Xingchen. Analysis of influence of LEO staring satellite dynamic tracking on imaging[J]. Infrared and Laser Engineering, 2014, 43(S1):203-208.
[2] 靳浩. 空间辐射对CMOS像感器性能影响的研究[D]. 哈尔滨:哈尔滨工业大学, 2012. JIN Hao. Research on CMOS image sensor of space radiation effect[D]. Harbin:Harbin Institute of Technology, 2012.
[3] 邓勤. 卫星颤振对遥感成像质量影响研究及实验验证[D]. 杭州:浙江大学, 2013. DENG Qin. Research on image degradation due to satellite platform vibration[D]. Hangzhou:Zhejiang University, 2013.
[4] 崔光茫. 光学遥感图像质量提升及评价技术研究[D]. 杭州:浙江大学, 2016. CUI Guangmang. Research on image quality improvement and assessment for optical remote sensing image[D]. Hangzhou:Zhejiang University, 2016.
[5] PARK S C, PARK M K, KANG M G. Super-resolution image reconstruction:a technical overview[J]. IEEE Signal Processing Magazine, 2003, 20(3):21-36.
[6] NASROLLAHI K, MOESLUND T B. Super-resolution:a comprehensive survey[J]. Machine Vision and Applications, 2014, 25(6):1423-1468.
[7] 袁小华, 欧阳晓丽, 夏德深. 超分辨率图像恢复研究综述[J]. 地理与地理信息科学, 2006, 22(3):43-47. YUAN Xiaohua, OUYANG Xiaoli, XIA Deshen. An overview on super resolution image restoration[J]. Geography and Geo-information Science, 2006, 22(3):43-47.
[8] 苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2013, 39(8):1202-1213. SU Heng, ZHOU Jie, ZHANG Zhihao. Survey of super-resolution image reconstruction methods[J]. Acta Automatica Sinica, 2013, 39(8):1202-1213.
[9] FARSIU S, ROBINSON M D, ELAD M, et al. Fast and robust multiframe super resolution[J]. IEEE Transactions on Image Processing, 2004, 13(10):1327-1344.
[10] AL ISMAEIL K, AOUADA D, OTTERSTEN B, et al. Multi-frame super-resolution by enhanced shift & add[C]//Proceedings of the 2013 8th International Symposium on Image and Signal Processing and Analysis. Trieste:IEEE, 2013:171-176.
[11] ELAD M, HEL-OR Y. A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur[J]. IEEE Transactions on Image Processing, 2001, 10(8):1187-1193.
[12] MUDENAGUDI U, BANERJEE B, KALRA P K. Space-time super-resolution using graph-cut optimization[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(5):995-1008.
[13] KONG Dan, HAN Mei, XU Wei, et al. A conditional random field model for video super-resolution[C]//Proceedings of the 18th International Conference on Pattern Recognition. Hong Kong, China:IEEE, 2006:619-622.
[14] SCHULTZ R R, STEVENSON R L. Extraction of high-resolution frames from video sequences[J]. IEEE Transactions on Image Processing, 1996, 5(6):996-1011.
[15] NGUYEN N, MILANFAR P, GOLUB G. A computationally efficient superresolution image reconstruction algorithm[J]. IEEE Transactions on Image Processing, 2001, 10(4):573-583.
[16] CHAN T F, WONG C K T. Multichannel image deconvolution by total variation regularization[C]//Proceedings of SPIE 3162, Advanced Signal Processing:Algorithms, Architectures, and Implementations Ⅶ. San Diego:SPIE, 1997:358-366.
[17] CHANTAS G, GALATSANOS N, LIKAS A, et al. Variational Bayesian image restoration based on a product of t-distributions image prior[J]. IEEE Transactions on Image Processing, 2008, 17(10):1795-1805.
[18] ZENG Xueying, YANG Lihua. A robust multiframe super-resolution algorithm based on half-quadratic estimation with modified BTV regularization[J]. Digital Signal Processing, 2013, 23(1):98-109.
[19] 沈焕锋. 场景变化条件下的影像超分辨率重建技术研究[D]. 武汉:武汉大学, 2007. SHEN Huanfeng. Super resolution image reconstruction under scene-change conditions[D]. Wuhan:Wuhan University, 2007.
[20] 卜丽静, 郑新杰, 肖一鸣, 等. "吉林一号"卫星视频影像超分辨率重建[J]. 国土资源遥感, 2017, 29(4):64-72. BU Lijing, ZHENG Xinjie, XIAO Yiming, et al. Research on super-resolution reconstruction for video image of Jilin-1 satellite[J]. Remote Sensing For Land & Resources, 2017, 29(4):64-72.
[21] HUBER P J. Robust statistics[M]. New York:Wiley, 1981.
[22] 胡义函, 张小刚, 陈华, 等. 一种基于鲁棒估计的极限学习机方法[J]. 计算机应用研究, 2012, 29(8):2926-2930. HU Yihan, ZHANG Xiaogang, CHEN Hua, et al. Extreme learning machine on robust estimation[J]. Application Research of Computers, 2012, 29(8):2926-2930.
[23] ZENG Xueying, YANG Lihua. A robust multiframe super-resolution algorithm based on half-quadratic estimation with modified BTV regularization[J]. Digital Signal Processing, 2013, 23(1):98-109.
[24] ELAD M, HEL-OR Y. A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur[J]. IEEE Transactions on Image Processing, 2001, 10(8):1187-1193.
[25] HE Hu, KONDI L P. An image super-resolution algorithm for different error levels per frame[J]. IEEE Transactions on Image Processing, 2006, 15(3):592-603.
[26] SCHULTZ R R, STEVENSON R L. Extraction of high-resolution frames from video sequences[J]. IEEE Transactions on Image Processing, 1996, 5(6):996-1011.
[27] 王密, 何鲁晓, 程宇峰, 等. 自适应高斯滤波与SFIM模型相结合的全色多光谱影像融合方法[J]. 测绘学报, 2018, 47(1):82-90. DOI:10.11947/j.AGCS.2018.20170421. WANG Mi, HE Luxiao, CHENG Yufeng, et al. Panchromatic and multi-spectral fusion method combined with adaptive Gaussian filter and SFIM model[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(1):82-90. DOI:10.11947/j.AGCS.2018.20170421.
[28] 翟永平, 周东翔, 刘云辉, 等. 聚焦函数性能评价指标设计及最优函数选取[J]. 光学学报, 2011, 31(4):0418002. ZHAI Yongping, ZHOU Dongxiang, LIU Yunhui, et al. Design of evaluation index for auto-focusing function and optimal function selection[J]. Acta Optica Sinica, 2011, 31(4):0418002.

顾及运动估计误差的“凝视”卫星视频运动场景超分辨率重建

Super-resolution reconstruction of “straring” satellite video motion scene considering motion estimation error

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 8

编辑推荐

Metrics

本文评价

[1]	赵超英, 王宝行. SAR干涉图降噪的稳健协方差矩阵分解法[J]. 测绘学报, 2019, 48(1): 24-33.
[2]	方兴, 黄李雄, 曾文宪, 吴云. 稳健估计的一种改进迭代算法[J]. 测绘学报, 2018, 47(10): 1301-1306.
[3]	吴佳奇, 张过, 汪韬阳, 蒋永华. 结合运动平滑约束与灰度特征的卫星视频点目标跟踪[J]. 测绘学报, 2017, 46(9): 1135-1146.
[4]	朱红, 宋伟东, 谭海, 王竞雪. 多尺度细节增强的遥感影像超分辨率重建[J]. 测绘学报, 2016, 45(9): 1081-1088.
[5]	王霞, 张过, 沈欣, 李贝贝, 蒋永华. 顾及像面畸变的卫星视频稳像[J]. 测绘学报, 2016, 45(2): 194-198.
[6]	钟九生江南胡斌胡秋翔. 一种遥感影像超分辨率重建的稀疏表示建模及算法[J]. 测绘学报, 2014, 43(3): 276-283.
[7]	周泽波,沈云中,李博峰. GPS/Doppler导航随机模型的移动窗口实时估计算法[J]. 测绘学报, 2011, 40(2): 220-225.
[8]	李博峰. 基于等效残差积探测粗差的方差-协方差分量估计[J]. 测绘学报, 2011, 40(1): 10-14.