监控视频中动态目标与地理空间信息的融合与可视化方法

doi:10.11947/j.AGCS.2019.20180572

测绘学报 ›› 2019, Vol. 48 ›› Issue (11): 1415-1423.doi: 10.11947/j.AGCS.2019.20180572

监控视频中动态目标与地理空间信息的融合与可视化方法

张旭¹, 郝向阳², 李建胜², 李朋月²

1. 航天工程大学, 北京 101416;
2. 信息工程大学地理空间信息学院, 河南郑州 450001

收稿日期:2018-12-10 修回日期:2019-05-18 出版日期:2019-11-20 发布日期:2019-11-19
通讯作者: 郝向阳 E-mail:xiangyanghao2004@163.com
作者简介:张旭(1994-),男,硕士生,研究方向为计算机视觉、导航定位与位置服务。E-mail:xuzhang_2016@126.com
基金资助:
国家863计划（2015AA7034057A）；国家自然科学基金（61173077）

Fusion and visualization method of dynamic targets in surveillance video with geospatial information

ZHANG Xu¹, HAO Xiangyang², LI Jiansheng², LI Pengyue²

1. Space Enginerring University, Beijing 101416, China;
2. Institute of Geographical Spatial Information, Information Engineering University, Zhengzhou 450001, China

Received:2018-12-10 Revised:2019-05-18 Online:2019-11-20 Published:2019-11-19
Supported by:
The National High-tech Research and Development Program of China (863 Program) (No. 2015AA7034057A);The National Natural Science Foundation of China(No. 61173077)

摘要/Abstract

摘要： 监控视频的动态前景目标智能分析是平安城市、智慧园区等安防建设的重要基础，将监控视频与地理空间数据融合可为静态的地理数据赋予动态属性。针对传统监控视频与地理信息数据集成仅仅将视频数据投射至地理空间，造成存储难、视频内容理解难度大等问题，本文提出了前景动态目标与地理空间信息的融合模型，通过推导出的映射模型将图像空间中的动态前景目标及跟踪轨迹映射至地理空间中，达到将监控视频与地理信息有机融合的目的。根据不同的应用需求，本文设计了4种多图层融合显示模式，实现了监控视频中的动态前景目标在地理空间的可视化。

关键词: 监控视频, 动态前景目标, 地理空间映射, 地理空间信息, 信息融合, 可视化

Abstract: The dynamic foreground target analysis of surveillance video is an important basis for security construction in safe cities and smart campuses. The dynamic attributes can be assigned to static geographic data by integrating surveillance video with geospatial data. For the integration of traditional surveillance video and geographic information data, only video data is projected into geospatial, which causes storage issue and difficult in understanding video content. The model that integrates geographic information and foreground dynamic targets, and integrates surveillance video with geographic information is proposed in this paper. And the dynamic foreground target and the tracking trajectory in the image are projected into the geospatial by the derived mapping model. The multi-layer fusion mode is utilized to distribute the video dynamic summary content in geospatial space.

Key words: surveillance video, dynamic foreground target, geospatialm apping, geospatial information, information fusion, visualization

中图分类号:

P208

张旭, 郝向阳, 李建胜, 李朋月. 监控视频中动态目标与地理空间信息的融合与可视化方法[J]. 测绘学报, 2019, 48(11): 1415-1423.

ZHANG Xu, HAO Xiangyang, LI Jiansheng, LI Pengyue. Fusion and visualization method of dynamic targets in surveillance video with geospatial information[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(11): 1415-1423.

参考文献 26

[1]	韩志刚, 孔云峰, 秦耀辰. 地理表达研究进展[J]. 地理科学进展, 2011, 30(2):141-148. HAN Zhigang, KONG Yunfeng, QIN Yaochen. Research on geographic representation:a review[J]. Progress in Geography, 2011, 30(2):141-148.
[2]	YUAN M, MARK D M, EGENHOFER M, et al. Extensions to geographic representations[M]//MCMASTER R, USERY L. A Research Agenda for Geographic Information Science. Boca Raton, FL:CRC Press, 2004:129-156.
[3]	LIPPMAN A. Movie-maps:An application of the optical videodisc to computer graphics[J]. ACM SIGGRAPH Computer Graphics, 1980, 14(3):32-42.
[4]	BILL R. Multimedia GIS-definition, requirements and applications[M]//The 1994 European GIS Yearbook. Oxford:Blackwell, 1994:151-154.
[5]	BERRY J K. Capture "where" and "when" on video-based GIS[J]. GeoWorld, 2000, 13(9):26-27.
[6]	谢潇, 朱庆, 张叶廷, 等. 多层次地理视频语义模型[J]. 测绘学报, 2015, 44(5):555-562. DOI:10.11947/j.AGCS.2015.20140176. XIE Xiao, ZHU Qing, ZHANG Yeting, et al. Hierarchical semantic model of geovideo[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(5):555-562. DOI:10.11947/j.AGCS.2015.20140176.
[7]	尹宏鹏, 陈波, 柴毅, 等. 基于视觉的目标检测与跟踪综述[J]. 自动化学报, 2016, 42(10):1466-1489. YIN Hongpeng, CHEN Bo, CHAI Yi, et al. Vision-based object detection and tracking:a review[J]. Acta Automatica Sinica, 2016, 42(10):1466-1489.
[8]	徐光祐, 曹媛媛. 动作识别与行为理解综述[J]. 中国图象图形学报, 2009, 14(2):189-195. XU Guangyou, CAO Yuanyuan. Action recognition and activity understanding:a review[J]. Journal of Image and Graphics, 2009, 14(2):189-195.
[9]	LUO Wenhan, XING Junjiang, MILAN A, et al. Multiple object tracking:a literature review[Z]. arXiv:1409.7618, 2015.
[10]	GIRGENSOHN A, SHIPMAN F, TURNER T, et al. Effects of presenting geographic context on tracking activity between cameras[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, California, USA:ACM, 2007:1167-1176.
[11]	LEWIS P, FOTHERINGHAM S, WINSTANLEY A. Spatial video and GIS[J]. International Journal of Geographical Information Science, 2011, 25(5):697-716.
[12]	SOURIMANT G, MORIN L, BOUATOUCH K. GPS, GIS and video registration for building reconstruction[C]//Proceedings of 2007 IEEE International Conference on Image Processing. San Antonio, TX, USA:IEEE, 2007:VI-401-VI-404.
[13]	XIE Yujia, WANG Meizhen, LIU Xuejun, et al. Surveillance video synopsis in GIS[J]. ISPRS International Journal of Geo-Information, 2017, 6(11):333.
[14]	宋宏权,孔云峰. Flex框架下网络视频GIS设计与实现[J]. 测绘科学, 2010, 35(5):208-210, 151. SONG Hongquan, KONG Yunfeng. Design and implementation of a web-based VideoGIS using Adobe Flex[J]. Science of Surveying & Mapping, 2010, 35(5):208-210, 151.
[15]	韩志刚, 曾明, 孔云峰. 校园地理视频监控WebGIS系统设计与实现[J]. 测绘科学, 2012, 37(1):195-197. HAN Zhigang, ZENG Ming, KONG Yunfeng.Design and implementation of the campus geovideo monitoring Web GIS system[J]. Science of Surveying & Mapping, 2012, 37(1):195-197.
[16]	CHEN Kuanwen, LEE P J, HUNG Y P. Egocentric view transition for video monitoring in a distributed camera network[C]//Proceedings of International Conference on Advances in Multimedia Modeling. Berlin:Springer-Verlag, 2011:171-181.
[17]	WANG Yi, BOWMAN D A. Effects of navigation design on contextualized video interfaces[C]//Proceedings of 2011 IEEE Symposium on 3D User Interfaces. Singapore:IEEE, 2011:27-34.
[18]	ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11):1330-1334.
[19]	LEPETIT V, MORENO-NOGUER F, FUA P. EPnP:An accurate O(n)solution to the PnP problem[J]. International Journal of Computer Vision, 2009, 81(2):155-166.
[20]	PENATE-SANCHEZ A, ANDRADE-CETTO J, MORENO-NOGUER F. Exhaustive linearization for robust camera pose and focal length estimation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2013, 35(10):2387-2400.
[21]	ZIVKOVIC Z. Improved adaptive Gaussian mixture model for background subtraction[C]//Proceedings of the 17th International Conference on Pattern Recognition.Cambridge, UK:IEEE, 2004:28-31.
[22]	WOJKE N, BEWLEY A, PAULUS D. Simple online and realtime tracking with a deep association metric[C]//Proceedings of 2017 IEEE International Conference on Image Processing. Beijing, China:IEEE, 2017:3645-3649.
[23]	KALMAN R E. A new approach to linear filtering and prediction problems[J]. Journal of Basic Engineering, 1960, 82(1):35-45.
[24]	KUHNH W. The Hungarian method for the assignment problem[J]. Naval Research Logistics Quarterly,1955, 2(1-2):83-97.
[25]	BERNARDIN K, STIEFELHAGEN R. Evaluating multiple object tracking performance:the clear MOT metrics[J]. EURASIP Journal on Image & Video Processing, 2008(1):246309.
[26]	葛宝义,左宪章,胡永江,视觉目标跟踪方法研究综述[J].中国图像图形学报,2008,23(8):1091-1107. GE Baoyi, ZUO Xianzhang, HU Yongjiang. Review of visual object tracking technology[J]. Journal of Image and Graphics, 2018,23(8):1091-1107.

监控视频中动态目标与地理空间信息的融合与可视化方法

Fusion and visualization method of dynamic targets in surveillance video with geospatial information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献 26

相关文章 15

编辑推荐

Metrics

本文评价

[1]	张良培, 何江, 杨倩倩, 肖屹, 袁强强. 数据驱动的多源遥感信息融合研究进展[J]. 测绘学报, 2022, 51(7): 1317-1337.
[2]	刘小波, 涂建光, 张海峰, 李治江. 国土综合整治三维模型碎片加载优化与调度[J]. 测绘学报, 2022, 51(4): 522-533.
[3]	李景文, 韦晶闪, 姜建武, 陆妍玲, 刘垒, 唐一飞, 李旭. 多视角监控视频中动态目标的时空信息提取方法[J]. 测绘学报, 2022, 51(3): 388-400.
[4]	刘振东, 戴昭鑫, 李成名, 刘晓丽. 三维GIS场景与多路视频融合的对象快速确定法[J]. 测绘学报, 2020, 49(5): 632-643.
[5]	尚戴雨, 丁雨淋, 朱庆, 吴林宝. 顾及地理矢量场空间变化特征的多分辨率纹理可视化方法[J]. 测绘学报, 2020, 49(5): 656-666.
[6]	刘嗣超, 武鹏达, 赵占杰, 李成名. 交通监控视频图像语义分割及其拼接方法[J]. 测绘学报, 2020, 49(4): 522-532.
[7]	卢万杰, 徐青, 蓝朝桢, 吕亮, 周杨. 遥感卫星区域覆盖实时分析与可视化[J]. 测绘学报, 2020, 49(10): 1321-1330.
[8]	李响, 王丽娜, 张卫东, 杨飞, 杨振凯. 面向双/多变量的连续面域拓扑图可视化方法[J]. 测绘学报, 2019, 48(6): 756-766.
[9]	龚建华, 李文航, 张国永, 申申, 黄琳, 孙麇. 增强地理环境中过程可视化方法——以人群疏散模拟为例[J]. 测绘学报, 2018, 47(8): 1089-1097.
[10]	刘铭崴, 朱庆, 朱军, 冯斌, 李赟, 张骏骁, 付萧, 张鹏程, 杨卫军, 宁新稳, 徐婉妍. 多模态时空数据多层次可视化任务模型[J]. 测绘学报, 2018, 47(8): 1098-1104.
[11]	张志强, 张新长, 辛秦川, 杨晓羚. 结合像元级和目标级的高分辨率遥感影像建筑物变化检测[J]. 测绘学报, 2018, 47(1): 102-112.
[12]	王丽娜, 李响, 江南, 杨振凯, 杨飞. 中心型时间地图的构建方法与实现[J]. 测绘学报, 2018, 47(1): 123-132.
[13]	艾廷华, 周梦杰, 李晓明. 网络空间同位模式的加色混合可视化挖掘方法[J]. 测绘学报, 2017, 46(6): 753-759.
[14]	宁津生, 王正涛. 从测绘学向地理空间信息学演变历程[J]. 测绘学报, 2017, 46(10): 1213-1218.
[15]	孟立秋. 地图学的恒常性和易变性[J]. 测绘学报, 2017, 46(10): 1637-1644.