Super-resolution reconstruction of “straring” satellite video motion scene considering motion estimation error

doi:10.11947/j.AGCS.2020.20180544

Abstract

Abstract: In the application of super-resolution reconstruction of staring satellite video image, due to inaccurate motion estimation, the reconstructed moving objects will appear "Grid" And "Tailing". in this paper, a motion scene super-resolution reconstruction method considering motion estimation error is proposed. The sensitivity of the regularized model expressed by L1 and L2 norms to noise is analyzed under the condition of motion estimation error.In this paper, robust estimation method is introduced to express the fidelity term of regularized model, so as to reduce the influence of motion estimation errors on the reconstructed results. On the basis of robust estimation model, tikhonov, TV and BTV regular terms are added respectively, and the super-resolution reconstruction effect of each model is analyzed. A bilateral filtering super-resolution reconstruction method based on robust estimation is proposed. The experiment chooses skybox and jilin-1 satellite video data. The results show that the method proposed in this paper is effective in reconstructing moving objects,and the details of the ground objects are clearer. In terms of normalized difference and gradient energy evaluation index, this method is superior to the classical method.

Key words: satellite video, super-resolution reconstruction, motion estimate, robust estimation

CLC Number:

P237

BU Lijing, ZHENG Xinjie, ZHANG Zhengpeng. Super-resolution reconstruction of “straring” satellite video motion scene considering motion estimation error[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(2): 214-224.

References

[1] 杨秀彬, 林星辰. 低轨凝视卫星动态跟踪对成像的影响分析[J]. 红外与激光工程, 2014, 43(S1):203-208. YANG Xiubin, LIN Xingchen. Analysis of influence of LEO staring satellite dynamic tracking on imaging[J]. Infrared and Laser Engineering, 2014, 43(S1):203-208.
[2] 靳浩. 空间辐射对CMOS像感器性能影响的研究[D]. 哈尔滨:哈尔滨工业大学, 2012. JIN Hao. Research on CMOS image sensor of space radiation effect[D]. Harbin:Harbin Institute of Technology, 2012.
[3] 邓勤. 卫星颤振对遥感成像质量影响研究及实验验证[D]. 杭州:浙江大学, 2013. DENG Qin. Research on image degradation due to satellite platform vibration[D]. Hangzhou:Zhejiang University, 2013.
[4] 崔光茫. 光学遥感图像质量提升及评价技术研究[D]. 杭州:浙江大学, 2016. CUI Guangmang. Research on image quality improvement and assessment for optical remote sensing image[D]. Hangzhou:Zhejiang University, 2016.
[5] PARK S C, PARK M K, KANG M G. Super-resolution image reconstruction:a technical overview[J]. IEEE Signal Processing Magazine, 2003, 20(3):21-36.
[6] NASROLLAHI K, MOESLUND T B. Super-resolution:a comprehensive survey[J]. Machine Vision and Applications, 2014, 25(6):1423-1468.
[7] 袁小华, 欧阳晓丽, 夏德深. 超分辨率图像恢复研究综述[J]. 地理与地理信息科学, 2006, 22(3):43-47. YUAN Xiaohua, OUYANG Xiaoli, XIA Deshen. An overview on super resolution image restoration[J]. Geography and Geo-information Science, 2006, 22(3):43-47.
[8] 苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2013, 39(8):1202-1213. SU Heng, ZHOU Jie, ZHANG Zhihao. Survey of super-resolution image reconstruction methods[J]. Acta Automatica Sinica, 2013, 39(8):1202-1213.
[9] FARSIU S, ROBINSON M D, ELAD M, et al. Fast and robust multiframe super resolution[J]. IEEE Transactions on Image Processing, 2004, 13(10):1327-1344.
[10] AL ISMAEIL K, AOUADA D, OTTERSTEN B, et al. Multi-frame super-resolution by enhanced shift & add[C]//Proceedings of the 2013 8th International Symposium on Image and Signal Processing and Analysis. Trieste:IEEE, 2013:171-176.
[11] ELAD M, HEL-OR Y. A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur[J]. IEEE Transactions on Image Processing, 2001, 10(8):1187-1193.
[12] MUDENAGUDI U, BANERJEE B, KALRA P K. Space-time super-resolution using graph-cut optimization[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(5):995-1008.
[13] KONG Dan, HAN Mei, XU Wei, et al. A conditional random field model for video super-resolution[C]//Proceedings of the 18th International Conference on Pattern Recognition. Hong Kong, China:IEEE, 2006:619-622.
[14] SCHULTZ R R, STEVENSON R L. Extraction of high-resolution frames from video sequences[J]. IEEE Transactions on Image Processing, 1996, 5(6):996-1011.
[15] NGUYEN N, MILANFAR P, GOLUB G. A computationally efficient superresolution image reconstruction algorithm[J]. IEEE Transactions on Image Processing, 2001, 10(4):573-583.
[16] CHAN T F, WONG C K T. Multichannel image deconvolution by total variation regularization[C]//Proceedings of SPIE 3162, Advanced Signal Processing:Algorithms, Architectures, and Implementations Ⅶ. San Diego:SPIE, 1997:358-366.
[17] CHANTAS G, GALATSANOS N, LIKAS A, et al. Variational Bayesian image restoration based on a product of t-distributions image prior[J]. IEEE Transactions on Image Processing, 2008, 17(10):1795-1805.
[18] ZENG Xueying, YANG Lihua. A robust multiframe super-resolution algorithm based on half-quadratic estimation with modified BTV regularization[J]. Digital Signal Processing, 2013, 23(1):98-109.
[19] 沈焕锋. 场景变化条件下的影像超分辨率重建技术研究[D]. 武汉:武汉大学, 2007. SHEN Huanfeng. Super resolution image reconstruction under scene-change conditions[D]. Wuhan:Wuhan University, 2007.
[20] 卜丽静, 郑新杰, 肖一鸣, 等. "吉林一号"卫星视频影像超分辨率重建[J]. 国土资源遥感, 2017, 29(4):64-72. BU Lijing, ZHENG Xinjie, XIAO Yiming, et al. Research on super-resolution reconstruction for video image of Jilin-1 satellite[J]. Remote Sensing For Land & Resources, 2017, 29(4):64-72.
[21] HUBER P J. Robust statistics[M]. New York:Wiley, 1981.
[22] 胡义函, 张小刚, 陈华, 等. 一种基于鲁棒估计的极限学习机方法[J]. 计算机应用研究, 2012, 29(8):2926-2930. HU Yihan, ZHANG Xiaogang, CHEN Hua, et al. Extreme learning machine on robust estimation[J]. Application Research of Computers, 2012, 29(8):2926-2930.
[23] ZENG Xueying, YANG Lihua. A robust multiframe super-resolution algorithm based on half-quadratic estimation with modified BTV regularization[J]. Digital Signal Processing, 2013, 23(1):98-109.
[24] ELAD M, HEL-OR Y. A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur[J]. IEEE Transactions on Image Processing, 2001, 10(8):1187-1193.
[25] HE Hu, KONDI L P. An image super-resolution algorithm for different error levels per frame[J]. IEEE Transactions on Image Processing, 2006, 15(3):592-603.
[26] SCHULTZ R R, STEVENSON R L. Extraction of high-resolution frames from video sequences[J]. IEEE Transactions on Image Processing, 1996, 5(6):996-1011.
[27] 王密, 何鲁晓, 程宇峰, 等. 自适应高斯滤波与SFIM模型相结合的全色多光谱影像融合方法[J]. 测绘学报, 2018, 47(1):82-90. DOI:10.11947/j.AGCS.2018.20170421. WANG Mi, HE Luxiao, CHENG Yufeng, et al. Panchromatic and multi-spectral fusion method combined with adaptive Gaussian filter and SFIM model[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(1):82-90. DOI:10.11947/j.AGCS.2018.20170421.
[28] 翟永平, 周东翔, 刘云辉, 等. 聚焦函数性能评价指标设计及最优函数选取[J]. 光学学报, 2011, 31(4):0418002. ZHAI Yongping, ZHOU Dongxiang, LIU Yunhui, et al. Design of evaluation index for auto-focusing function and optimal function selection[J]. Acta Optica Sinica, 2011, 31(4):0418002.