A Study on Data Storage and Management for Massive Remote Sensing Data Based on Multi-level Grid Model

doi:10.11947/j.AGCS.2016.F013

Abstract

Abstract: With the rapid development of remote sensing technology, spatial information is exploding. For current remote sensing data storage management system, their data volume, rich data sources, query retrieves slow and other issues are problems to be solved. This paper then proposed a remote sensing data organization scheme based on GeoSOT. By firstly adding a GeoSOT code column which is array format in relational database, spatial information in the metadata can be stored and logically subdivided, in order to achieve unified storage and retrieval of image data space area. We compare our method with Oracle platform by simulating worldwide image data. Experimental results show that the retrieval efficiency of this article has obvious advantages and can effectively improve the integration of remote sensing data, retrieval efficiency. Our approach also offers a more effective storage management program for existing storage center or management system.

Key words: GeoSOT, remote sensing data, metadata, array, inverted index

CLC Number:

P208

LI Shuang, CHENG Chengqi, TONG Xiaochong, CHEN Bo, ZHAI Weixin. A Study on Data Storage and Management for Massive Remote Sensing Data Based on Multi-level Grid Model[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(S1): 106-114.

References

[1] 李德仁, 张良培, 夏桂松. 遥感大数据自动分析与数据挖掘[J]. 测绘学报, 2014, 43(12):1211-1216. DOI:10.13485/j.cnki.11-208.2014.0187. LI Deren, ZHANG Liangpei, XIA Guisong. Automatic Analysis and Mining of Remote Sensing Big Data[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(12):1211-1216. DOI:10.13485/j.cnki.11-208.2014.0187.
[2] 程承旗, 任伏虎, 濮国梁, 等. 空间信息剖分组织导论[M]. 北京:科学出版社, 2012. CHENG Chengqi, REN Fuhu, PU Guoliang, et al. An Introduce to Spatial Information Subdivision Organization[M]. Beijing:Science Press, 2012.
[3] 程承旗, 关丽. 基于地图分幅拓展的全球剖分模型及其地址编码研究[J]. 测绘学报, 2010, 39(3):295-302. CHENG Chengqi, GUAN Li. The Global Subdivision Grid Based on Extended Mapping Division and Its Address Coding[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(3):295-302.
[4] ESFANDIARI M, RAMAPRIYAN H, BEHNKE J, et al. Earth Observing System (EOS) Data and Information System (EOSDIS)-Evolution Update and Future[C]//Proceedings of IEEE International Geoscience and Remote Sensing Symposium. Barcelona:IEEE, 2007:4005-4008.
[5] ALBANI S, GIARETTA D. Long-term Preservation of Earth Observation Data and Knowledge in ESA Through CASPAR[J]. International Journal of Digital Curation, 2009, 4(3):4-16.
[6] GIBIN M, SINGLETON A, MILTON R, et al. An Exploratory Cartographic Visualisation of London Through the Google Maps API[J]. Applied Spatial Analysis and Policy, 2008, 1(2):85-97.
[7] GUO Wei, GONG Jianya, JIANG Wanshou, et al. OpenRS-Cloud:A Remote Sensing Image Processing Platform Based on Cloud Computing Environment[J]. Science China Technological Sciences, 2010, 53(S1):221-230.
[8] SCHWARTZ J. Bing Maps Tile System[EB/OL].[2016-03-20].http://msdn.microsoft.com/en-us/library/bb259689.aspx.
[9] BOSCHETTI L, ROY D P, JUSTICE C O. Using NASA's World Wind Virtual Globe for Interactive Internet Visualization of the Global MODIS Burned area Product[J]. International Journal of Remote Sensing, 2008, 29(11):3067-3072.
[10] 吕雪锋, 程承旗, 龚健雅, 等. 海量遥感数据存储管理技术综述[J]. 中国科学:技术科学, 2011, 41(12):1561-1573. LÜ Xuefeng, CHENG Chengqi, GONG Jianya, et al. Review of Data Storage and Management Technologies for Massive Remote Sensing Data[J]. Science China Technological Sciences, 2011,41(12):1561-1573.
[11] 李志刚, 蒋捷, 翟永, 等. 面向分布式服务聚合的"天地图" 总体技术架构[J]. 测绘地理信息, 2012, 37(5):13-15. LI Zhigang, JIANG Jie, ZHAI Yong, et al. "TIANDITU" Technical Architecture for Supporting Distributed Service Aggregation[J]. Journal of Geomatics, 2012, 37(5):13-15.
[12] 原发杰. 一种新的海量遥感瓦片影像数据存储检索策略[D]. 成都:电子科技大学, 2013. YUAN Fajie. A New Strategy of Storage & Retrieval for Massive Tile Data of Remote Sensing Images[D]. Chengdu:University of Electronic Science and Technology of China, 2013.
[13] 宋树华, 程承旗, 濮国梁, 等. 全球遥感数据剖分组织的GeoSOT网格应用[J]. 测绘学报, 2014, 43(8):869-876. DOI:10.13485/j.cnki.11-2089.2014.0103. SONG Shuhua, CHENG Chengqi, PU Guoliang, et al. Global Remote Sensing Data Subdivision Organization Based on GeoSOT[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(8):869-876. DOI:10.13485/j.cnki.11-2089.2014.0103.
[14] 金安, 程承旗, 宋树华, 等. 基于Geohash的面数据区域查询[J]. 地理与地理信息科学, 2013, 29(5):31-35. JIN An, CHENG Chengqi, SONG Shuhua, et al. Regional Query of Area Data Based on Geohash[J]. Geography and Geo-Information Science, 2013, 29(5):31-35.
[15] 金安. 地球空间剖分编码代数模型及应用初探[D]. 北京:北京大学, 2013. JIN An. Global Subdivision Code Algebra Model and its Application[D]. Beijing:Peking University, 2013.
[16] 冯敏, 诸云强, 张鸣之, 等. 多源遥感影像共享平台的设计与实现[J]. 地球信息科学, 2008, 10(1):102-108. FENG Min, ZHU Yunqiang, ZHANG Mingzhi, et al. Design and Realization of Multi-source Remote Sensing Images Sharing Platform[J]. Geo-information Science, 2008, 10(1):102-108.
[17] 盛震宇, 冯钧. 基于XML Schema的水利元数据可视化方法[J]. 电子器件, 2013, 36(4):540-545. SHENG Zhenyu, FENG Jun. A Hydrology Metadata Visualization Method Based on XML Schema[J]. Chinese Journal of Electron Devices, 2013, 36(4):540-545.
[18] 徐周, 黄上腾. 基于XML实现数据库间信息交换的方法[J]. 计算机工程, 2001, 27(4):177-179. XU Zhou, HUANG Shangteng. XML-based Method of Information Exchanging Between Databases[J]. Computer Engineering, 2001, 27(4):177-179.
[19] 李满春, 陈刚, 陈振杰, 等. GIS设计与实现[M]. 2版. 北京:科学出版社, 2011. LI Manchun, CHEN Gang, CHEN Zhenjie, et al. GIS Design and Application[M]. 2nd ed. Beijing:Science Express, 2011.
[20] 代万能. 倒排索引技术在Hadoop平台上的研究与实现[D]. 成都:电子科技大学, 2013. DAI Wanneng. Study and Implementation of Inverted Index on Hadoop[D]. Chengdu:University of Electronic Science and Technology of China, 2013.