Fusion and visualization method of dynamic targets in surveillance video with geospatial information

doi:10.11947/j.AGCS.2019.20180572

Abstract

Abstract: The dynamic foreground target analysis of surveillance video is an important basis for security construction in safe cities and smart campuses. The dynamic attributes can be assigned to static geographic data by integrating surveillance video with geospatial data. For the integration of traditional surveillance video and geographic information data, only video data is projected into geospatial, which causes storage issue and difficult in understanding video content. The model that integrates geographic information and foreground dynamic targets, and integrates surveillance video with geographic information is proposed in this paper. And the dynamic foreground target and the tracking trajectory in the image are projected into the geospatial by the derived mapping model. The multi-layer fusion mode is utilized to distribute the video dynamic summary content in geospatial space.

Key words: surveillance video, dynamic foreground target, geospatialm apping, geospatial information, information fusion, visualization

CLC Number:

P208

ZHANG Xu, HAO Xiangyang, LI Jiansheng, LI Pengyue. Fusion and visualization method of dynamic targets in surveillance video with geospatial information[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(11): 1415-1423.

References 26

[1]	韩志刚, 孔云峰, 秦耀辰. 地理表达研究进展[J]. 地理科学进展, 2011, 30(2):141-148. HAN Zhigang, KONG Yunfeng, QIN Yaochen. Research on geographic representation:a review[J]. Progress in Geography, 2011, 30(2):141-148.
[2]	YUAN M, MARK D M, EGENHOFER M, et al. Extensions to geographic representations[M]//MCMASTER R, USERY L. A Research Agenda for Geographic Information Science. Boca Raton, FL:CRC Press, 2004:129-156.
[3]	LIPPMAN A. Movie-maps:An application of the optical videodisc to computer graphics[J]. ACM SIGGRAPH Computer Graphics, 1980, 14(3):32-42.
[4]	BILL R. Multimedia GIS-definition, requirements and applications[M]//The 1994 European GIS Yearbook. Oxford:Blackwell, 1994:151-154.
[5]	BERRY J K. Capture "where" and "when" on video-based GIS[J]. GeoWorld, 2000, 13(9):26-27.
[6]	谢潇, 朱庆, 张叶廷, 等. 多层次地理视频语义模型[J]. 测绘学报, 2015, 44(5):555-562. DOI:10.11947/j.AGCS.2015.20140176. XIE Xiao, ZHU Qing, ZHANG Yeting, et al. Hierarchical semantic model of geovideo[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(5):555-562. DOI:10.11947/j.AGCS.2015.20140176.
[7]	尹宏鹏, 陈波, 柴毅, 等. 基于视觉的目标检测与跟踪综述[J]. 自动化学报, 2016, 42(10):1466-1489. YIN Hongpeng, CHEN Bo, CHAI Yi, et al. Vision-based object detection and tracking:a review[J]. Acta Automatica Sinica, 2016, 42(10):1466-1489.
[8]	徐光祐, 曹媛媛. 动作识别与行为理解综述[J]. 中国图象图形学报, 2009, 14(2):189-195. XU Guangyou, CAO Yuanyuan. Action recognition and activity understanding:a review[J]. Journal of Image and Graphics, 2009, 14(2):189-195.
[9]	LUO Wenhan, XING Junjiang, MILAN A, et al. Multiple object tracking:a literature review[Z]. arXiv:1409.7618, 2015.
[10]	GIRGENSOHN A, SHIPMAN F, TURNER T, et al. Effects of presenting geographic context on tracking activity between cameras[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. San Jose, California, USA:ACM, 2007:1167-1176.
[11]	LEWIS P, FOTHERINGHAM S, WINSTANLEY A. Spatial video and GIS[J]. International Journal of Geographical Information Science, 2011, 25(5):697-716.
[12]	SOURIMANT G, MORIN L, BOUATOUCH K. GPS, GIS and video registration for building reconstruction[C]//Proceedings of 2007 IEEE International Conference on Image Processing. San Antonio, TX, USA:IEEE, 2007:VI-401-VI-404.
[13]	XIE Yujia, WANG Meizhen, LIU Xuejun, et al. Surveillance video synopsis in GIS[J]. ISPRS International Journal of Geo-Information, 2017, 6(11):333.
[14]	宋宏权,孔云峰. Flex框架下网络视频GIS设计与实现[J]. 测绘科学, 2010, 35(5):208-210, 151. SONG Hongquan, KONG Yunfeng. Design and implementation of a web-based VideoGIS using Adobe Flex[J]. Science of Surveying & Mapping, 2010, 35(5):208-210, 151.
[15]	韩志刚, 曾明, 孔云峰. 校园地理视频监控WebGIS系统设计与实现[J]. 测绘科学, 2012, 37(1):195-197. HAN Zhigang, ZENG Ming, KONG Yunfeng.Design and implementation of the campus geovideo monitoring Web GIS system[J]. Science of Surveying & Mapping, 2012, 37(1):195-197.
[16]	CHEN Kuanwen, LEE P J, HUNG Y P. Egocentric view transition for video monitoring in a distributed camera network[C]//Proceedings of International Conference on Advances in Multimedia Modeling. Berlin:Springer-Verlag, 2011:171-181.
[17]	WANG Yi, BOWMAN D A. Effects of navigation design on contextualized video interfaces[C]//Proceedings of 2011 IEEE Symposium on 3D User Interfaces. Singapore:IEEE, 2011:27-34.
[18]	ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11):1330-1334.
[19]	LEPETIT V, MORENO-NOGUER F, FUA P. EPnP:An accurate O(n)solution to the PnP problem[J]. International Journal of Computer Vision, 2009, 81(2):155-166.
[20]	PENATE-SANCHEZ A, ANDRADE-CETTO J, MORENO-NOGUER F. Exhaustive linearization for robust camera pose and focal length estimation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2013, 35(10):2387-2400.
[21]	ZIVKOVIC Z. Improved adaptive Gaussian mixture model for background subtraction[C]//Proceedings of the 17th International Conference on Pattern Recognition.Cambridge, UK:IEEE, 2004:28-31.
[22]	WOJKE N, BEWLEY A, PAULUS D. Simple online and realtime tracking with a deep association metric[C]//Proceedings of 2017 IEEE International Conference on Image Processing. Beijing, China:IEEE, 2017:3645-3649.
[23]	KALMAN R E. A new approach to linear filtering and prediction problems[J]. Journal of Basic Engineering, 1960, 82(1):35-45.
[24]	KUHNH W. The Hungarian method for the assignment problem[J]. Naval Research Logistics Quarterly,1955, 2(1-2):83-97.
[25]	BERNARDIN K, STIEFELHAGEN R. Evaluating multiple object tracking performance:the clear MOT metrics[J]. EURASIP Journal on Image & Video Processing, 2008(1):246309.
[26]	葛宝义,左宪章,胡永江,视觉目标跟踪方法研究综述[J].中国图像图形学报,2008,23(8):1091-1107. GE Baoyi, ZUO Xianzhang, HU Yongjiang. Review of visual object tracking technology[J]. Journal of Image and Graphics, 2018,23(8):1091-1107.