Spaceborne lightweight image control points generation method

doi:10.11947/j.AGCS.2022.20200203

Abstract

Abstract: In order to facilitate on-orbit processing and end-to-end mapping application of intelligent remote sensing satellite system, lightweight and on-orbit global control information has to be provided and effectively used. In this paper, a spaceborne lightweight image control points generation method is presented. Firstly, under the condition of sparse or no ground control points, global image control points are generated through the bundle adjustment of domestic high-resolution stereo mapping satellite images. Then, by describing the local image of the image control point to the feature vector, an on-board lightweight representation mode of image control points is designed, and its storage performance and on-board matching application strategies are analyzed. Finally, the Hash function obtained by hash learning is used to convert the feature vector of image control points into hash code, which can be furtherly applied to generate deep lightweight spaceborne image control points. Experiments of image control point extraction, eigenvector description, lightweight processing and matching performance analysis are completed on multi-type satellite image data in this paper. The on-orbit matching and application feasibility of lightweight image control point is verified, and abilities of lightweight global image control point are concluded.

Key words: intelligent remote sensing satellite system, image control point, eigenvector, Hash algorithm, lightweight processing

CLC Number:

P237

JI Song, ZHANG Yongsheng, DONG Yang, FAN Dazhao. Spaceborne lightweight image control points generation method[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(3): 413-425.

References

[1] 王密,杨芳.智能遥感卫星与遥感影像实时服务[J].测绘学报,2019,48(12):1586-1594. DOI:10.11947/j.AGCS.2019.20190454. WANG Mi, YANG Fang. Intelligent remote sensing satellite and remote sensing image real-time service[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(12):1586-1594. DOI:10.11947/j.AGCS.2019.20190454.
[2] 李德仁,王密,沈欣,等.从对地观测卫星到对地观测脑[J].武汉大学学报(信息科学版),2017,42(2):143-149. LI Deren, WANG Mi, SHEN Xin, et al. From earth observation satellite to earth observation brain[J]. Geomatics and Information Science of Wuhan University, 2017, 42(2):143-149.
[3] 王密,田原,程宇峰.高分辨率光学遥感卫星在轨几何定标现状与展望[J].武汉大学学报(信息科学版),2017,42(11):1580-1588. WANG Mi, TIAN Yuan, CHENG Yufeng. Development of on-orbit geometric calibration for high resolution optical remote sensing satellite[J].Geomatics and Information Science of Wuhan University, 2017, 42(11):1580-1588.
[4] 李德仁,张过,蒋永华,等.国产光学卫星影像几何精度研究[J].航天器工程,2016,25(1):1-9. LI Deren, ZHANG Guo, JIANG Yonghua, et al. Research on image geometric precision of domestic optical satellites[J]. Spacecraft Engineering, 2016, 25(1):1-9.
[5] 唐新明,王鸿燕,祝小勇.资源三号卫星测绘技术与应用[J].测绘学报,2017,46(10):1482-1491. DOI:10.11947/j.AGCS.2017.20170251. TANG Xinming, WANG Hongyan, ZHU Xiaoyong. Technology and applications of surveying and mapping for ZY-3 Satellites[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10):1482-1491.DOI:10.11947/j.AGCS.2017.20170251.
[6] 肖化超,周诠,张建华.遥感卫星在轨机场变化检测方法[J].测绘通报,2015(1):22-25, 38. XIAO Huachao, ZHOU Quan, ZHANG Jianhua. An airport change onboard detection method for remote sensingsatellite[J]. Bulletin of Surveying and Mapping, 2015(1):22-25, 38.
[7] 李德仁.论空天地一体化对地观测网络[J].地球信息科学学报,2012,14(4):419-425. LI Deren. On space-air-ground integrated earth observation network[J]. Journal of Geo-Information Science, 2012, 14(4):419-425.
[8] CRISP N, SMITH K, HOLLINGSWORTH P. Small satellite launch to LEO:a review of current and future launch systems[J]. Transactions of the Japan Society for Aeronautical and Space Sciences, 2014, 12(29):39-47.
[9] 蒲生亮,邓非,张婧,等.控制点影像库构建与多源影像联合空三定位[J].遥感信息,2017,32(1):71-78. PU Shengliang, DENG Fei, ZHANG Jing, et al. Construction of GCP image-chips library for combining spatial triangulation georeferencing of multi-source imagery[J]. Remote Sensing Information, 2017, 32(1):71-78.
[10] 王贵满.影像控制点数据库建立与应用[D].长沙:中南大学,2008. WANG Guiman. Foundation and application of GCP database[D]. Changsha:Central South University, 2008.
[11] 张宇坤.多源控制点影像匹配策略及控制点影像库设计研究[D].西安:西北大学,2008. ZHANG Yukun. Research of image matching strategy on multi-source control point images and design of control point images database[D]. Xi'an:Northwest University, 2008.
[12] 王月莉,李发红,王占宏.多级多源控制点影像数据库系统的设计与实现[J].测绘通报,2013(3):86-88,115. WANG Yueli, LI Fahong, WANG Zhanhong. Design and implementation on image chip database system of ground control points for multistage and multi-source[J]. Bulletin of Surveying and Mapping, 2013(3):86-88,115.
[13] 田林.应急三维地形影像控制数据库构建与应用研究[D].阜新:辽宁工程技术大学,2014. TIAN Lin. Study on the establishment and application of GCP image and DEM database for emergency[D]. Fuxin:Liaoning Technical University, 2014.
[14] 张继贤,马瑞金.图形图像控制点库及应用[J].测绘通报,2000(1):15-17. ZHANG Jixian, MA Ruijin. Control point data base for graph and imagery and its application[J]. Bulletin of Surveying and Mapping, 2000(1):15-17.
[15] 张永生.遥感测绘卫星全球广域定标定位框架体系[J].测绘科学技术学报,2013,30(4):416-423. ZHANG Yongsheng. Global wide area framework of calibration and positioning for remote sensing and mapping satellites[J]. Journal of Geomatics Science and Technology, 2013, 30(4):416-423.
[16] 陈小卫.公开DEM辅助的国产卫星影像无地面控制点定位技术研究[D].郑州:信息工程大学,2017. CHENG Xiaowei. Public DEM-aided geopositioning without ground control points for Chinese satellite imagery[D]. Zhengzhou:Information Engineering University, 2017.
[17] 徐楠,李朝阳,王兆琦,等.高轨卫星星载计算机优化设计与实现[J].中国空间科学技术,2020,40(1):94-100. XU Nan, LI Zhaoyang, WANG Zhaoqi, et al. Optimization design and realization of GEO satellite onboard computer[J]. Chinese Space Science and Technology, 2020, 40(1):94-100.
[18] 李新明,李小将,李艺,等.分布式卫星嵌入式计算机系统结构设计方法[J].中国空间科学技术,2010,30(2):1-8. LI Xinming, LI Xiaojiang, LI Yi, et al. Method of designing embedded computer system architecture in distributed satellite[J]. Chinese Space Science and Technology, 2010, 30(2):1-8.
[19] 杨志柳.面向遥感图像特殊目标检测算法的星载实时处理器实现[D].北京:北京理工大学,2016. YANG Zhiliu. The implementation of spaceborne real-time processor for target recognition in remote sensing image[D]. Beijing:Beijing Institute of Technology, 2016.
[20] PI Yingdong, XIE Baorong, YANG Bo, et al. On-orbit geometric calibration of linear push-broom optical satellite based on sparse GCPs[J]. Journal of Geodesy and Geoinformation Science, 2020, 3(1):64-75.
[21] 徐硕,江万寿,牛春盈.基于控制点影像库的控制点自动选取初探[J].遥感信息,2008,23(2):35-38. XU Shuo, JIANG Wanshou, NIU Chunying. A preliminary study on automatic selection of GCP based on image database[J]. Remote Sensing Information, 2008, 23(2):35-38.
[22] GRUEN A. Development and status of image matching in photogrammetry[J]. The Photogrammetric Record, 2012, 27(137):36-57.
[23] 杨博,王密,皮英冬.仅用虚拟控制点的超大区域无控制区域网平差[J].测绘学报,2017,46(7):874-881.DOI:10.11947/j.AGCS.2017.20160588. YANG Bo, WANG Mi, PI Yingdong. Block-adjustment without GCPs for large-scale regions only based on the virtual control points[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(7):874-881.DOI:10.11947/j.AGCS.2017.20160588.
[24] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[25] 张盈,张景雄.顾及空间相关性的遥感影像信息量的度量方法[J].测绘学报,2015,44(10):1117-1124. DOI:10.11947/j.AGCS.2015.20140417. ZHANG Ying, ZHANG Jingxiong. Measure of information content of remotely sensed images accounting for spatial correlation[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(10):1117-1124. DOI:10.11947/j.AGCS.2015.20140417.
[26] 刘恬.基于FPGA的图像压缩存储设计与实现[D].南京:南京理工大学, 2018. LIU Tian. Design and implementation of image compression and storage based on FPGA[D]. Nanjing:Nanjing University of Science & Technology, 2018.
[27] 董杨,范大昭,纪松,等.一种区域立体快速自适应重建方法[J].测绘学报,2016,45(10):1241-1249.DOI:10.11947/j.AGCS.2016.20150651. DONG Yang, FAN Dazhao, JI Song, et al. A rapid adaptive reconstruction method for stereoscopic images[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(10):1241-1249.DOI:10.11947/j.AGCS.2016.20150651.
[28] YU Guoshen, MOREL J M. ASIFT:an algorithm for fully affine invariant comparison[J]. Image Processing On Line, 2011, 1:11-38.
[29] MOREL J M, YU Guoshen.ASIFT:a new framework for fully affine invariant image comparison[J]. SIAM Journal on Imaging Sciences, 2009, 2(2):438-469.
[30] SALAKHUTDINOV R, HINTON G. Semantic hashing[J]. International Journal of Approximate Reasoning, 2009, 50(7):969-978.
[31] 马绍覃.基于哈希算法的图像检索研究[D].武汉:武汉科技大学,2019. MA Shaoqin. Research of hashing-based method for image retrieval[D]. Wuhan:Wuhan University of Science and Technology, 2019.
[32] STRECHA C, BRONSTEIN A M, BRONSTEIN M M, et al. LDAHash:improved matching with smaller descriptors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(1):66-78.