Live-streaming geographic information service: remote immersive perception of on-site conditions based on VR panoramas

doi:10.11947/j.AGCS.2025.20250178

Abstract

Abstract:

Live-streaming geographic information services have great application potential in fields such as emergency command, construction management, and environmental monitoring. However, traditional methods struggle to meet users' comprehensive demands for on-site geographic information that is all-encompassing, high-fidelity, analyzable, and highly timely. Therefore, this study establishes a VR-panoramic-based remote immersive perception method and equipment system for on-site live situations. First, a panoramic camera mounting head was built for use in complex geographic environments. Second, a remote transmission mechanism for geographic information based on panoramic video was designed. Third, a display-analyze-explore multi-level enhanced remote immersive sensing method was proposed for live field scenarios. Fourth, VR panoramic remote immersive sensing equipment and a prototype system were developed. Finally, case experiment analysis is conducted. The results show that the method presented in this paper enables remote users to perceive and analyze on-site geographic information in an immersive manner, thereby realizing multi-level on-site live geographic information services in complex environments, with the delay time of the live broadcast stabilized at approximately 6 seconds. The audio and video are clear and smooth, which has a significant advantage compared to other methods in terms of immersion, real-time capabilities, and geographic specialization. It provides an example reference for UAV VR panorama technology to empower mapping and geographic information services.

Key words: geographic information services, live streaming, remote immersive perception, VR panorama, UAVs

CLC Number:

P208

Jinbin ZHANG, Jun ZHU, Pei DANG, Yuxuan ZHOU, Bowen YANG. Live-streaming geographic information service: remote immersive perception of on-site conditions based on VR panoramas[J]. Acta Geodaetica et Cartographica Sinica, 2025, 54(12): 2276-2286.

Figures/Tables 14

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Tab. 1

Fig. 5

Fig. 6

Tab. 2

Fig. 7

Fig. 8

Fig. 9

Tab. 3

Fig. 10

Fig. 11

References 34

[1]	李德仁, 邵振峰. 信息化测绘的本质是服务[J]. 测绘通报, 2008(5): 1-4.
	LI Deren, SHAO Zhenfeng. The intrinsic property of geo-informatics is service[J]. Bulletin of Surveying and Mapping, 2008(5): 1-4.
[2]	李德仁, 徐小迪, 邵振峰. 论万物互联时代的地球空间信息学[J]. 测绘学报, 2022, 51(1): 1-8. DOI: . doi: 10.11947/j.AGCS.2022.20210564
	LI Deren, XU Xiaodi, SHAO Zhenfeng. On geospatial information science in the era of IoE[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(1): 1-8. DOI: . doi: 10.11947/j.AGCS.2022.20210564
[3]	王家耀. 关于地理信息系统未来发展的思考[J]. 武汉大学学报(信息科学版), 2022, 47(10): 1535-1545.
	WANG Jiayao. Thoughts on the future development of geographic information system[J]. Geomatics and Information Science of Wuhan University, 2022, 47(10): 1535-1545.
[4]	ZHU Jun, ZHANG Jinbin, ZHU Qing, et al. A knowledge-guided visualization framework of disaster scenes for helping the public cognize risk information[J]. International Journal of Geographical Information Science, 2024, 38(4): 626-653.
[5]	ZHU Jun, ZHANG Jinbin, ZHU Qing, et al. Virtual geographical scene twin modeling: a combined data-driven and knowledge-driven method with bridge construction as a case study[J]. International Journal of Digital Earth, 2024, 17(1): 1-23.
[6]	张永生. 现场直播式地理空间信息服务的构思与体系[J]. 测绘学报, 2011, 40(1): 1-4.
	ZHANG Yongsheng. The conception and architecture of live-service for geospatial informationd[J]. Acta Geodaetica et Cartographica Sinica, 2011, 40(1): 1-4.
[7]	李科, 熊自明, 杜琳. 基于全景视频的虚拟地理环境建模技术研究[J]. 系统仿真学报, 2013, 25(8): 1871-1875.
	LI Ke, XIONG Ziming, DU Lin. Research for visual geographic environment model design based on panorama video[J]. Journal of System Simulation, 2013, 25(8): 1871-1875.
[8]	ZHU Yiwen, ZHANG Xumin, YAN Simin, et al. Research on spatial patterns and mechanisms of live streaming commerce in China based on geolocation data[J]. ISPRS International Journal of Geo-Information, 2023, 12(6): 229.
[9]	梁美盈, 陈实. 疫情背景下地理直播课堂学习环境分析[J]. 地理教学, 2020(8): 27-30.
	LIANG Meiying, CHEN Shi. The analysis of the learning environment of geography live classes in the context of the epidemic situation[J]. Geography Teaching, 2020(8): 27-30.
[10]	商世民, 徐祺娴. 助农直播中地理标志文化传播的空间转向[J]. 中南民族大学学报(人文社会科学版), 2022, 42(12): 82-89.
	SHANG Shimin, XU Qixian. Spatial turn in communication of geographical indication culture in livestream advertising of agricultural products[J]. Journal of South-Central Minzu University (Humanities and Social Sciences), 2022, 42(12): 82-89.
[11]	LI Yufei, XIE Yakun, CHEN Mingzhen, et al. A multi-level semantic constraint approach for highway tunnel scene twin modeling[J]. Journal of Geodesy and Geoinformation Science, 2025, 8(2): 37-56.
[12]	李维森. 中国地理信息产业发展展望[J]. 资源导刊, 2024(24): 10-11.
	LI Weisen. The development prospect of China's geographic information industry[J]. Resources Guide, 2024(24): 10-11.
[13]	徐开明. 让新质生产力成为测绘地理信息高质量发展的引擎[J]. 中国测绘, 2024(4): 19-23.
	XU Kaiming. Making new quality productivity the engine of high-quality development of mapping and geographic information[J]. China Surveying and Mapping, 2024(4): 19-23.
[14]	ZHANG Jinbin, ZHU Jun, ZHOU Yuxuan, et al. Exploring geospatial digital twins: a novel panorama-based method with enhanced representation of virtual geographic scenes in virtual reality (VR)[J]. International Journal of Geographical Information Science, 2024, 38(11): 2301-2324.
[15]	AO Ying, LI Penglong, Li Wen, et al. Fully convolutional networks for street furniture identification in panorama images[J]. Journal of Geodesy and Geoinformation Science, 2022, 5(4): 59-71.
[16]	DANG Pei, ZHU Jun, ZHOU Yuxuan, et al. A 3D-panoramic fusion flood enhanced visualization method for VR[J]. Environmental Modelling & Software, 2023, 169: 105810.
[17]	李栋. 整车VR全景图生成展示系统的设计与实现[D]. 成都: 电子科技大学, 2024.
	LI Dong. Design and implementation of vehicle VR panorama generation and display system[D]. Chengdu: University of Electronic Science and Technology of China, 2024.
[18]	陈志, 李阳靖, 罗超, 等. 空地一体多源数据融合的历史建筑数字化关键技术研究[J]. 测绘通报, 2025(S1): 179-184.
	CHEN Zhi, LI Yangjing, LUO Chao, et al. Research on historical building surveying methods based on integrated air-ground multi-source data[J]. Bulletin of Surveying and Mapping, 2025(S1): 179-184.
[19]	叶成英, 李建微, 陈思喜. VR全景视频传输研究进展[J]. 计算机应用研究, 2022, 39(6): 1601-1607.
	YE Chengying, LI Jianwei, CHEN Sixi. Research progress of VR panoramic video transmission[J]. Application Research of Computers, 2022, 39(6): 1601-1607.
[20]	CINNAMON J, JAHIU L. 360-degree video for virtual place-based research: a review and research agenda[J]. Computers, Environment and Urban Systems, 2023, 106: 102044.
[21]	黄明伟, 沈泉飞, 庄旭, 等. 轻便式全景设备在城市三维全景建设中的应用[J]. 地理空间信息, 2021, 19(9): 100-102.
	HUANG Mingwei, SHEN Quanfei, ZHUANG Xu, et al. Application of portable panoramic equipment in urban 3D panoramic construction[J]. Geospatial Information, 2021, 19(9): 100-102.
[22]	廖小罕, 张捷, 黄耀欢. 浅析低空地理学的特征及其对地理学的拓展[J]. 地理学报, 2024, 79(3): 551-564.
	LIAO Xiaohan, ZHANG Jie, HUANG Yaohuan. Views on characters of low-altitude airspace geography and its impact onthe geography development[J]. Acta Geographica Sinica, 2024, 79(3): 551-564.
[23]	卢嘉伟. 无人机倾斜摄影在工程项目管理决策中的应用探索[J]. 测绘与空间地理信息, 2024, 47(5): 218-220.
	LU Jiawei. Application of UAV oblique photogrammety in engineering project management decision[J]. Geomatics & Spatial Information Technology, 2024, 47(5): 218-220.
[24]	杨铭. 空地一体遥感技术在轨道交通安全保护区巡查中的应用[J]. 测绘通报, 2024(S2): 178-181.
	YANG Ming. The application of integrated air-ground remote sensing technology in the inspection of rail transit safety protection area[J]. Bulletin of Surveying and Mapping, 2024(S2): 178-181.
[25]	贾仕奎, 李云云, 张向阳, 等. 3D打印成型工艺及PLA材料在打印中的应用最新进展[J]. 应用化工, 2020, 49(12): 3185-3190.
	JIA Shikui, LI Yunyun, ZHANG Xiangyang, et al. Recent progress on 3D processing methods and applications of 3D printing PLA[J]. Applied Chemical Industry, 2020, 49(12): 3185-3190.
[26]	林珲, 龚建华. 论虚拟地理环境[J]. 测绘学报, 2002, 31(1): 1-6.
	LIN Hui, GONG Jianhua. Onvirtual geographic environments[J]. Acta Geodaetica et Cartographica Sinica, 2002, 31(1): 1-6.
[27]	林珲, 胡明远, 陈旻, 等. 从地理信息系统到虚拟地理环境的认知转变[J]. 地球信息科学学报, 2020, 22(4): 662-672.
	LIN Hui, HU Mingyuan, CHEN Min, et al. Cognitive transformation from geographic information system to virtual geographic environments[J]. Journal of Geo-information Science, 2020, 22(4): 662-672.
[28]	XU Bingli, XIAO Xin, WANG Yiqing, et al. Concept and framework of digital twin human geographical environment[J]. Journal of Environmental Management, 2025, 373: 123866.
[29]	马良. 全景视频传输系统的关键技术优化研究[D]. 武汉: 华中科技大学, 2024.
	MA Liang. Research on optimization of key technologies of panoramic video transmission system[D]. Wuhan: Huazhong University of Science and Technology, 2024.
[30]	SODAGAR I. The MPEG-DASH standard for multimedia streaming over the Internet[J]. IEEE Multimedia, 2011, 18(4): 62-67.
[31]	LI Weilian, ZHU Jun, DANG Pei, et al. Immersive virtual reality as a tool to improve bridge teaching communication[J]. Expert Systems with Applications, 2023, 217: 119502.
[32]	MACEACHREN A M. Visualization in modern cartography: setting the agenda[M]//Visualization in modern cartography. New York: Pergamon, 1994: 1-12.
[33]	LA SALANDRA A, FRAJBERG D, FRATERNALI P. A virtual reality application for augmented panoramic mountain images[J]. Virtual Reality, 2020, 24(1): 123-141.
[34]	BRIVIO E, SERINO S, NEGRO COUSA E, et al. Virtual reality and 360° panorama technology: a media comparison to study changes in sense of presence, anxiety, and positive emotions[J]. Virtual Reality, 2021, 25(2): 303-311.

层级Ⅰ	层级Ⅱ	层级Ⅲ	层级Ⅳ
地理过程	时间信息	发生时间、结束时间	具体地理信息
	类别信息	暴雨洪水、溃坝洪水
	数值信息	水深、流速、淹没面积
	因果信息	暴雨、河道堵塞
	空间语义属性	几何形状	长、宽、高
	空间语义属性	坐标位置	（B，L，H）
地理实体	非空间语义属性	名称标识	***桥
		从属类别	中承式自锚悬索桥
		用途描述	铁路公路两用桥梁
		地理过程影响	未被洪水淹没

类别	名称	详细信息
硬件	无人机负载平台	大疆M300 RTK无人机
	全景采集设备	TECHE 360Anywhere四目鱼眼全景相机
	5G模块	华为5G CPE Pro移动路由器、5G SIM卡
	笔记本	拯救者R9000P 2021版
	移动VR眼镜	Oculus Quest 2
	3D打印设备	创维CR5-PRO 3D打印机
软件	视频实时传输平台	TECHE Anywhere Control
	视频处理编辑平台	TECHE Anywhere Stitcher
	云服务器平台	Aliyun ECS
	开发平台	Unity 3D 2021.3.33f1c1
	开发语言	C#、Python 3.10

分析指标	基于视频图像	基于遥感影像	基于虚拟场景	本文方法
现场环境	动态/真实	静态/真实	静态/虚拟	动态/真实
空间信息	无	有	有	有
三维信息	无	无	有	有
语义引导	无	无	有	有
沉浸感知	不支持	不支持	部分支持	支持
远程交互	不支持	不支持	不支持	支持