Progress of hyperspectral remote sensing applications on cultural relics protection

doi:10.11947/j.AGCS.2023.20220655

Abstract

Abstract: Cultural relics are the crystallization of historical, artistic, and scientific values in the development of human civilization, and it contains historical and cultural information. Cultural relics digitization is an important link for their protection, restoration, and reconstruction. As an important supplement of traditional cultural relics digitization ways, hyperspectral remote sensing can quickly and non-destructively obtain the material, pigment, and processing traces of cultural relics, and provide physical and chemical properties of cultural relics surface for the digital resources of cultural relics. In this paper, the equipment and methods of hyperspectral information collection in the field are summarized and analyzed, and then the key technologies of hyperspectral information processing in the field of cultural relics protection are reviewed, and summarized the four aspects of information increase, information extraction, information classification and visualization, and compares and analyzes the common methods. Based on the comparison and analysis of the common methods, the typical application of hyperspectral technology in the field of cultural preservation is summarized, including the analysis and recognition of pigment species, the extraction of hidden information and the recognition of repaired traces. Finally, the future research directions of hyperspectral cultural relics applications are prospected.

Key words: cultural relics, hyperspectral, information acquisition, information processing, application

CLC Number:

P227

ZHANG Lifu, WANG Sa, ZHANG Yan, YUAN Deshuai, SONG Ruoxi, QI Wenchao, QU Liang, LU Zhiyong, TONG Qingxi. Progress of hyperspectral remote sensing applications on cultural relics protection[J]. Acta Geodaetica et Cartographica Sinica, 2023, 52(7): 1126-1138.

References

[1] GOETZ A F, VANE G, SOLOMON J E, et al. Imaging spectrometry for Earth remote sensing[J]. Science, 1985, 228(4704):1147-1153.
[2] 童庆禧, 张兵, 张立福. 中国高光谱遥感的前沿进展[J]. 遥感学报, 2016, 20(5):689-707. TONG Qingxi, ZHANG Bing, ZHANG Lifu. Current progress of hyperspectral remote sensing in China[J]. Journal of Remote Sensing, 2016, 20(5):689-707.
[3] GOETZ A F H. Three decades of hyperspectral remote sensing of the Earth:a personal view[J]. Remote Sensing of Environment, 2009, 113:S5-S16.
[4] TONG Qingxi, XUE Yongqi, ZHANG Lifu. Progress in hyperspectral remote sensing science and technology in China over the past three decades[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014, 7(1):70-91.
[5] GOETZ A F H. Hyperspectral imaging and quantitative remote sensing[C]//Proceedings of 1995 Land Satellite Information in the Next Decade. Vienna:[s.n.], 1995:206-215.
[6] 刘银年. 高光谱成像遥感载荷技术的现状与发展[J]. 遥感学报, 2021, 25(1):439-459. LIU Yinnian. Development of hyperspectral imaging remote sensing technology[J]. National Remote Sensing Bulletin, 2021, 25(1):439-459.
[7] 国宏伟. 快照式高光谱相机的设计及开发[D]. 天津:天津大学, 2017. GUO Hongwei. Design and development of a snapshot hyperspectral camera[D]. Tianjin:Tianjin University, 2017.
[8] 张兵. 时空信息辅助下的高光谱数据挖掘[D].北京:中国科学院遥感应用研究所, 2002. ZHANG Bing. Hyperspectral data mining aided by spatio-temporal information[D]. Beijing:Institute of Remote Sensing Application Chinese Academy of Sciences,2002.
[9] 高泽东, 高洪兴, 朱院院, 等. 快照式光谱成像技术综述[J]. 光学精密工程, 2020, 28(6):1323-1343. GAO Zedong, GAO Hongxing, ZHU Yuanyuan, et al. Review of snapshot spectral imaging technologies[J]. Optics and Precision Engineering, 2020, 28(6):1323-1343.
[10] 郭新蕾, 张立福, 吴太夏, 等. 成像光谱技术的古画隐藏信息提取[J]. 中国图象图形学报, 2017, 22(10):1428-1435. GUO Xinlei, ZHANG Lifu, WU Taixia, et al. Hidden information extraction from the ancient painting using hyperspectral imaging technology[J]. Journal of Image and Graphics, 2017, 22(10):1428-1435.
[11] 史宁昌, 李广华, 雷勇, 等. 高光谱成像技术在故宫书画文物保护中的应用[J]. 文物保护与考古科学, 2017, 29(3):23-29. SHI Ningchang, LI Guanghua, LEI Yong, et al. Hyperspectral imaging to Chinese paintings at the Palace Museum[J]. Sciences of Conservation and Archaeology, 2017, 29(3):23-29.
[12] 韩炜师, 王丽琴. 光谱分析技术在彩绘文物颜料分析中的应用[J]. 光谱学与光谱分析, 2012, 32(12):3394-3398. HAN Weishi, WANG Liqin. Application of spectral technologies in analyzing pigments of colored relics[J]. Spectroscopy and Spectral Analysis, 2012, 32(12):3394-3398.
[13] 巩梦婷, 张秋佳, 杜少飞, 等. 高光谱成像技术对宜宾市博物院藏族谱印记的分析[J]. 文物保护与考古科学, 2021, 33(5):78-84. GONG Mengting, ZHANG Qiujia, DU Shaofei, et al. Application of hyperspectral imaging technology to family genealogy in Yibin Museum[J]. Sciences of Conservation and Archaeology, 2021, 33(5):78-84.
[14] 岑奕, 张琳姗, 孙雪剑, 等. 唐卡主色矿物颜料光谱分析[J]. 光谱学与光谱分析, 2019, 39(4):1136-1142. CEN Yi, ZHANG Linshan, SUN Xuejian, et al. Spectral analysis of main mineral pigments in thangka[J]. Spectroscopy and Spectral Analysis, 2019, 39(4):1136-1142.
[15] 周新光, 沈骅, 吴来明. 高光谱图像系统应用于模糊印章的提取研究[J]. 文物保护与考古科学, 2020, 32(1):56-60. ZHOU Xinguang, SHEN Hua, WU Laiming. Application of hyperspectral image system to the extraction of blurred seals[J]. Sciences of Conservation and Archaeology, 2020, 32(1):56-60.
[16] 马琳娜, 马生涛, 张加万, 等. 秦始皇帝陵出土二号青铜马车彩绘夔龙纹复原方法研究[J]. 文物保护与考古科学, 2021, 33(1):17-25. MA Linna, MA Shengtao, ZHANG Jiawan, et al. Research on the method for restoration of the Kuilong pattern on the No. 2 Qin bronze chariot excavated from the Emperor Qinshihuang's Mausoleum Site[J]. Sciences of Conservation and Archaeology, 2021, 33(1):17-25.
[17] 刘欣蔚, 陈美华, 刘媛. 高光谱成像技术在充胶处理宝石鉴定中的应用:以翡翠和绿松石为例[J]. 宝石和宝石学杂志, 2019, 21(1):1-11. LIU Xinwei, CHEN Meihua, LIU Yuan. Application of hyperspectral imaging technique in identification of polymer-impregnated gemstone:taking jadeite and turquoise as example[J]. Journal of Gems & Gemmology, 2019, 21(1):1-11.
[18] 谢意红, 王成云. 不同颜色翡翠的微量元素及红外光谱特征[J]. 岩矿测试, 2003, 22(3):183-187. XIE Yihong, WANG Chengyun. Trace elements in jadeites with different color and their infrared spectra characteristics[J]. Rock and Mineral Analysis, 2003, 22(3):183-187.
[19] 袁心强, 亓利剑, 杜广鹏, 等. 缅甸翡翠紫外-可见-近红外光谱的特征和意义[J]. 宝石和宝石学杂志, 2003, 5(4):11-16. YUAN Xinqiang, QI Lijian, DU Guangpeng, et al. UV-VIS-NIR spectrum of jadeite jade from Burma[J]. Journal of Gems & Gemology, 2003, 5(4):11-16.
[20] 赵恒谦, 强加成, 赵红蕊, 等. 历代景德镇青花瓷光谱特征分析研究[J]. 光谱学与光谱分析, 2019, 39(3):942-947. ZHAO Hengqian, QIANG Jiacheng, ZHAO Hongrui, et al. Research on the absorption feature analysis of Jingdezhen blue and white porcelain[J]. Spectroscopy and Spectral Analysis, 2019, 39(3):942-947.
[21] WU Taixia, ZHANG Lifu, CEN Yi, et al. Light weight airborne imaging spectrometer remote sensing system for mineral exploration in China[C]//Proceedings of 2014 Spectral Imaging Sensor Technologies:Innovation Driving Advanced Application Capabilities. Baltimore:SPIE, 2014:910406.
[22] 丁新峰. 基于高光谱成像技术的文物颜料研究[D]. 北京:北京建筑大学, 2015. DING Xinfeng. Ancient Chinese painting pigments research based on hyper-spectral imaging technology[D]. Beijing:Beijing University of Civil Engineering and Architecture, 2015.
[23] 杜楠. 基于多特征融合的文物图像分类研究[D]. 重庆:重庆大学, 2017. DU Nan. Research on cultural relics images classification based on multi-features fusion[D]. Chongqing:Chongqing University, 2017.
[24] 杨琴, 丁莉, 姜鹏, 等. 基于高光谱成像的书画模糊印章信息增强研究[J]. 中国国家博物馆馆刊, 2022(7):136-147. YANG Qin, DING Li, JIANG Peng, et al. Study on extraction of blurred seals in calligraphy and painting based on hyperspectral imaging technology[J]. Journal of National Museum of China, 2022(7):136-147.
[25] 相建凯, 吴萌, 王展, 等. 图像增强在文物X光图像中的应用[J]. 激光与光电子学进展, 2019, 56(6):265-270. XIANG Jiankai, WU Meng, WANG Zhan, et al. Application of image enhancement in X-ray photography of cultural relics[J]. Laser & Optoelectronics Progress, 2019, 56(6):265-270.
[26] PAN Ning, HOU Miaole, LÜ Shuqiang, et al. Extracting faded mural patterns based on the combination of spatial-spectral feature of hyperspectral image[J]. Journal of Cultural Heritage, 2017, 27:80-87.
[27] 侯妙乐, 雷勇, 芦鑫, 等. 基于高光谱数据的壁画底稿信息提取[J]. 测绘科学, 2014, 39(10):89-92, 101. HOU Miaole, LEI Yong, LU Xin, et al. Manuscript information extraction research of mural based on hyperspectral data[J]. Science of Surveying and Mapping, 2014, 39(10):89-92, 101.
[28] 毛锦程, 吕书强, 侯妙乐, 等. 基于分块PCA与端元提取的壁画线条增强研究[J]. 图学学报, 2022, 43(3):425-433. MAO Jincheng, LV Shuqiang, HOU Miaole, et al. Research on mural line enhancement based on block PCA and endmember extraction[J]. Journal of Graphics, 2022, 43(3):425-433.
[29] PENG Jinye, YU Kai, WANG Jun, et al. Mining painted cultural relic patterns based on principal component images selection and image fusion of hyperspectral images[J]. Journal of Cultural Heritage, 2019, 36:32-39.
[30] ZHAO Tong, PENG Minghan, YANG Mingxing, et al. Effects of weathering on FTIR spectra and origin traceability of archaeological amber:the case of the Han Tomb of Haihun Marquis, China[J]. Journal of Archaeological Science, 2023, 153:105753.
[31] XIA Jingjing, ZHANG Jixiong, ZHAO Yueting, et al. Fourier transform infrared spectroscopy and chemometrics for the discrimination of paper relic types[J]. Spectrochimica Acta Part A:Molecular and Biomolecular Spectroscopy, 2019, 219:8-14.
[32] 武锋强, 杨武年, 李丹. 基于光谱特征拟合的艺术画颜料成分识别研究[J]. 光散射学报, 2014, 26(1):88-92. WU Fengqiang, YANG Wunian, LI Dan. Research on art painting pigment composition recognition based on spectra feature fitting[J]. The Journal of Light Scattering, 2014, 26(1):88-92.
[33] 巩梦婷, 冯萍莉. 高光谱成像技术在中国画颜料分类和识别上的应用初探:以光谱角填图(SAM)为例[J]. 文物保护与考古科学, 2014, 26(4):76-83. GONG Mengting, FENG Pingli. Preliminary study on the application of hyperspectral imaging in the classification of and identification Chinese traditional pigments classification:a case study of spectral angle mapper[J]. Sciences of Conservation and Archaeology, 2014, 26(4):76-83.
[34] LI G H, CHEN Y, SUN X J, et al. An automatic hyperspectral scanning system for the technical investigations of Chinese scroll paintings[J]. Microchemical Journal, 2020, 155:104699.
[35] HOU Miaole, ZHOU Pingping, LÜ Shuqiang, et al. Virtual restoration of stains on ancient paintings with maximum noise fraction transformation based on the hyperspectral imaging[J]. Journal of Cultural Heritage, 2018, 34:136-144.
[36] 马文武, 侯妙乐, 胡云岗. 基于地面高光谱遥感的石碑特征信息提取[J]. 北京建筑大学学报, 2015, 31(2):65-69. MA Wenwu, HOU Miaole, HU Yungang. Stone feature information extraction based on hyper-spectral remote sensing[J]. Journal of Beijing University of Civil Engineering and Architecture, 2015, 31(2):65-69.
[37] 丁莉, 龚天怡, 杨琴, 等. 便携式近红外光纤光谱在纺织品文物纤维无损检测中的应用[J]. 文物保护与考古科学, 2021, 33(4):128-136. DING Li, GONG Tianyi, YANG Qin, et al. Non-destructive fiber type identification in ancient textiles using portable near- infrared fiber optic reflectance spectroscopy[J]. Sciences of Conservation and Archaeology, 2021, 33(4):128-136.
[38] 武望婷, 张陈锋, 高爱东, 等. 基于高光谱技术对一幅清代画信息提取研究[J]. 文物保护与考古科学, 2017, 29(4):45-52. WU Wangting, ZHANG Chenfeng, GAO Aidong, et al. Hyperspectral study of a Qing Dynasty painting[J]. Sciences of Conservation and Archaeology, 2017, 29(4):45-52.
[39] HOU Miaole, CAO Ning, TAN Li, et al. Extraction of hidden information under sootiness on murals based on hyperspectral image enhancement[J]. Applied Sciences, 2019, 9(17):3591.
[40] HAN D, MA L, MA S, et al. The digital restoration of painted patterns on the No.2 Qin bronze chariot based on hyperspectral imaging[J]. Archaeometry, 2020, 62(1):200-212.
[41] PAN Gang, SUN Di, ZHAN Rui, et al. Mural sketch generation via style-aware convolutional neural network[C]//Proceedings of 2018 Computer Graphics International.Bintan:ACM, 2018:239-245.
[42] PENG Jinye, WANG Jiaxin, WANG Jun, et al. A relic sketch extraction framework based on detail-aware hierarchical deep network[J]. Signal Processing, 2021, 183:108008.
[43] 戴若辰, 唐欢, 汤斌, 等. 基于高光谱成像的纸质文物"狐斑"检测方法研究[J]. 光谱学与光谱分析, 2022, 42(5):1567-1571. DAI Ruochen, TANG Huan, TANG Bin, et al. Study on detection method of foxing on paper artifacts based on hyperspectral imaging technology[J]. Spectroscopy and Spectral Analysis, 2022, 42(5):1567-1571.
[44] 丁莉, 杨琴, 姜鹏, 等. 基于高光谱成像技术的中国古代书画研究:以中国国家博物馆藏《职贡图》(北宋摹本)为例[J]. 中国国家博物馆馆刊, 2022(7):148-159. DING Li, YANG Qin, JIANG Peng, et al. Research on ancient Chinese calligraphy and painting based on hyperspectral imaging technology-a case study of tribute envoys of the song dynasty stowed at national museum of China[J]. Journal of National Museum of China, 2022(7):148-159.
[45] 孙美君, 柴勃隆, 张冬, 等. 基于近红外高光谱技术的敦煌莫高窟壁画起甲病害风险评估方法[J]. 文物保护与考古科学, 2016, 28(4):1-8. SUN Meijun, CHAI Bolong, ZHANG Dong, et al. Assessing the degree of flaking of the murals in the Dunhuang Mogao Grottoes using near-infrared hyperspectral imaging[J]. Sciences of Conservation and Archaeology, 2016, 28(4):1-8.
[46] 刘晓琴, 侯妙乐, 董友强, 等. 基于高光谱影像的瞿昙寺壁画颜料层脱落病害评估[J]. 地理信息世界, 2019, 26(5):22-28. LIU Xiaoqin, HOU Miaole, DONG Youqiang, et al. Extraction and evaluation of the disease of the mural paint loss[J]. Geomatics World, 2019, 26(5):22-28.
[47] 周平平, 侯妙乐, 赵学胜, 等. 基于高光谱影像分类线性回归的古画污渍虚拟恢复[J]. 地理信息世界, 2017, 24(3):113-118. ZHOU Pingping, HOU Miaole, ZHAO Xuesheng, et al. Virtual restoration of ancient painting stains based on classified linear regression of hyper-spectral image[J]. Geomatics World, 2017, 24(3):113-118.
[48] 张琳姗. 基于高光谱技术的唐卡矿物颜料信息定量提取研究[D]. 成都:成都理工大学, 2019. ZHANG Linshan. Research on quantitative extraction of tangka mineral pigments information based on hyperspectral technology[D]. Chengdu:Chengdu University of Technology, 2019.
[49] ZOU Zheng, ZHAO Peng, ZHAO Xuefeng. Virtual restoration of the colored paintings on weathered beams in the Forbidden City using multiple deep learning algorithms[J]. Advanced Engineering Informatics, 2021, 50:101421.
[50] 王珺, 孙进越, 俞凯, 等. 基于分组LSTM与CNN的青铜器锈蚀类别智能标识方法[J]. 西北大学学报(自然科学版), 2021, 51(5):778-786. WANG Jun, SUN Jinyue, YU Kai, et al. Intelligent identification method of bronze rust category based on grouping LSTM and CNN[J]. Journal of Northwest University (Natural Science Edition), 2021, 51(5):778-786.
[51] RAKHIMOL V, MAHESWARI P U. Restoration of ancient temple murals using cGAN and PConv networks[J]. Computers & Graphics, 2022,109:100-110.
[52] 张立福, 孙雪剑, 张霞, 等. 时空谱多维数据格式(MDD)结构与计算机配套系统[J]. 全球变化数据学报(中英文), 2017, 1(2):121-135, 140. ZHANG Lifu, SUN Xuejian, ZHANG Xia, et al. A multi-dimensional data format (MDD) and analysis tool[J]. Journal of Global Change Data and Discovery, 2017, 1(2):121-135,140.
[53] LIU Yanzhen, TANG Yunwei, JING Linhai, et al. Remote sensing-based dynamic monitoring of immovable cultural relics, from environmental factors to the protected cultural site:a case study of the shunji bridge[J]. Sustainability, 2021, 13(11):6042.
[54] BALAS C, PAPADAKIS V, PAPADAKIS N, et al. A novel hyper-spectral imaging apparatus for the non-destructive analysis of objects of artistic and historic value[J]. Journal of Cultural Heritage, 2003, 4(S1):330-337.
[55] CASINI A, LOTTI F, PICOLLO M, et al. Image spectroscopy mapping technique for noninvasive analysis of paintings[J]. Studies in Conservation, 1999, 44(1):39-48.
[56] CLOUTIS E, MACKAY A, NORMAN L, et al. Identification of historic artists' pigments using spectral reflectance and X-ray diffraction properties I. iron oxide and oxy-hydroxide-rich pigments[J]. Journal of Near Infrared Spectroscopy, 2016, 24(1):27-45.
[57] CLOUTIS E, NORMAN L, CUDDY M, et al. Spectral reflectance (350-2500 nm) properties of historic artists' pigments. II. red-orange-yellow chromates, jarosites, organics, lead (-tin) oxides,sulfides, nitrites and antimonates[J]. Journal of Near Infrared Spectroscopy, 2016, 24(2):119-140.
[58] BACCI M, CASINI A, CUCCI C, et al. Non-invasive spectroscopic measurements on the Ⅱ ritratto della figliastra by Giovanni Fattori:identification of pigments and colourimetric analysis[J]. Journal of Cultural Heritage, 2003, 4(4):329-336.
[59] VERMEULEN M, MIRANDA A S O, TAMBURINI D, et al. A multi-analytical study of the palette of impressionist and post-impressionist Puerto Rican artists[J]. Heritage Science, 2022, 10(1):1-22.
[60] 武锋强, 杨武年, 李丹. 基于高光谱成像与拉曼技术的艺术画颜料成分对比检测研究[J]. 矿物学报, 2014, 34(2):166-170. WU Fengqiang, YANG Wunian, LI Dan. Research on art painting pigment composition recognition based on hyperspectral imaging technique and Raman spectra[J]. Acta Mineralogica Sinica, 2014, 34(2):166-170.
[61] 补雅晶, 万晓霞, 李俊锋, 等. 基于可见光谱特征提取的敦煌壁画颜料识别方法研究[J]. 文物保护与考古科学, 2017, 29(3):45-51. BU Yajing, WAN Xiaoxia, LI Junfeng, et al. Automatic pigment recognition of Dunhuang murals based on feature extraction of visible reflectance spectrum[J]. Sciences of Conservation and Archaeology, 2017, 29(3):45-51.
[62] 武望婷, 谭丽, 侯妙乐, 等. 高光谱技术在书画检测中的应用研究:以王震《三秋图》为例[J]. 地理信息世界, 2017, 24(3):101-106. WU Wangting, TAN Li, HOU Miaole, et al. Application of hyper-spectral technologies in detection of Chinese painting and calligraphy:a case study of "Sanqiutu"[J]. Geomatics World, 2017, 24(3):101-106.
[63] 李德辉, 吴太夏, 王树东, 等. 文物红色系颜料高光谱识别指数研究[J]. 光谱学与光谱分析, 2022, 42(5):1588-1594. LI Dehui, WU Taixia, WANG Shudong, et al. Hyperspectral indices for identification of red pigments used in cultural relic[J]. Spectroscopy and Spectral Analysis, 2022, 42(5):1588-1594.
[64] 李广华, 陈垚, 段佩权, 等. 中国书画文物研究中的自动高光谱扫描系统应用[J]. 中国博物馆, 2021, 38(S2):180-185. LI Guanghua, CHEN Yao, DUAN Peiquan, et al. Study on the application of an automatic hyperspectral scanning system to investigate Chinese paintings[J]. Chinese Museum, 2021, 38(S2):180-185.
[65] 王乐乐, 李志敏, 马清林, 等. 高光谱技术无损鉴定壁画颜料之研究:以西藏拉萨大昭寺壁画为例[J]. 敦煌研究, 2015(3):122-128. WANG Lele, LI Zhimin, MA Qinglin, et al. Non-destructive and In-situ identification of pigments in wall paintings using hyperspectral technology[J]. Dunhuang Research, 2015(3):122-128.
[66] SUN Meijun, ZHANG Dong, WANG Zheng, et al. What's wrong with the murals at the mogao grottoes:a near-infrared hyperspectral imaging method[J]. Scientific Reports, 2015, 5:14371.