Localization initialization for multi-beam LiDAR considering indoor scene feature

doi:10.11947/j.AGCS.2021.20210268

Abstract

Abstract: For the problem of localization initialization (LI) of robot in indoor large-scale scene, a localization initialization method based on feature pattern is proposed. Firstly, with feature analysis of indoor scene structure, the proposed method explores robust man-made structures (e.g., walls, columns and some other structures with spatial location indication function), which are defined as feature patterns to improve robustness of scene feature expression. Then, with characteristics of multi-beam light detection and ranging (LiDAR) point cloud, a feature pattern extraction method in real-time data is proposed to improve efficiency of feature expression with a hierarchical management. Next, a semi-automatic processing method is proposed to extract feature patterns from point cloud map, and an efficient data management pipeline is designed to avoid repeatedly redundant operations on map data during multiple times initialization to improve efficiency of LI. Finally, two kinds of error equations are constructed for different feature patterns. With L-M gradient descent solution and hit ratio of map grid as metric, an adaptive matching and registration strategy is proposed to accomplish LI of robot in large-scale indoor scene. In order to verify feasibility of this method, a low-cost 16-line LiDAR was used in the experiment in three typical indoor scenes i.e., corridor, hall and underground parking lot. The experimental results show that LI is accomplished quickly and accurately with proposed method in large-scale indoor scene, and it basically meets the localization accuracy and efficiency requirements of indoor robot in practical application.

Key words: autonomous driving, indoor robot, localization initialization, feature pattern, LiDAR, point cloud map

CLC Number:

P227

SHI Pengcheng, YE Qin, ZHANG Shaoming, DENG Haifeng. Localization initialization for multi-beam LiDAR considering indoor scene feature[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(11): 1594-1604.

References

[1] 刘经南, 詹骄, 郭迟, 等. 智能高精地图数据逻辑结构与关键技术[J]. 测绘学报, 2019,48(8):939-953. DOI: 10.11947/j.AGCS.2019.20190125. LIU Jingnan, ZHAN Jiao, GUO Chi, et al. Data logic structure and key technologies on intelligent high-precision map[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(8): 939-953. DOI: 10.11947/j.AGCS.2019.20190125.
[2] YAN Li, DAI Jicheng, TAN Junxiang, et al. Global fine registration of point cloud in LiDAR slam based on pose graph[J]. Journal of Geodesy and Geoinformation Science,2020,3(2):26-35.
[3] CHENG Chuanqi, HAO Xiangyang, LI Jiansheng, et al. A robust Gaussian mixture model for mobile robots’ vision-based pose estimation[J]. Journal of Geodesy and Geoinformation Science,2019,2(3):79-90.
[4] 邸凯昌, 万文辉, 赵红颖, 等. 视觉SLAM技术的进展与应用[J]. 测绘学报, 2018,47(6):770-779. DOI:10.11947/j.AGCS.2018.20170652. DI Kaichang, WAN Wenhui, ZHAO Hongying, et al. Progress and applications of visual slam[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(6): 770-779. DOI:10.11947/j.AGCS.2018.20170652.
[5] MUR-ARTAL R, MONTIEL J. ORB-SLAM: a versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics, 2015,31(5):1147-1163.
[6] ENGEL J, SCHOPS T, CREMERS D. LSD-SLAM: large-scale direct monocular SLAM[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014:834-849.
[7] ZHANG J, SINGH S. Low-drift and real-time LiDAR odometry and mapping[J]. Autonomous Robots, 2017,41(2):401-416.
[8] SHAN T, ENGLOT B. LeGO-LOAM: lightweight and ground-optimized LiDAR odometry and mapping on variable terrain[C]//Proceedings of 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Madrid, Spain: IEEE, 2018:4758-4765.
[9] 唐恒博,陈卫东,王景川, 等.高精度高鲁棒性的轨道机器人全局定位方法[J].机器人,2013,35(5):623-629. TANG Hengbo, CHEN Weidong, WANG Jingchuan, et al. High-precision and high-robustness global localization for rail robots[J]. ROBOT, 2013,35(5):623-629.
[10] 贺锋, 秦晓丽, 方勇纯. 一种基于遗传算法的移动机器人自定位方法[J]. 模式识别与人工智能, 2009,22(1):142-147. HE Feng, QIN Xiaoli, FANG Yongchun. A genetic algorithm based autonomous localization strategy for mobile robots[J] Pattern Recognition and Artificial Intelligence. 2009,22(1):142-147.
[11] SUZUKI T. Mobile robot localization with GNSS multipath detection using pseudorange residuals[J]. Advanced Robotics, 2019,33(12):602-613.
[12] YAN F, VYSOTSKA O, STACHNISS C. Global localization on openstreetmap using 4-bit semantic descriptors[C]//Proceedings of 2019 European Conference on Mobile Robots (ECMR). Prague, Czech Republic: IEEE, 2019.
[13] 庄惠敏, 曹其新. 探测车基于可视路标的全局定位[J]. 上海交通大学学报, 2009,43(6):871-874. ZHUANG Huimin, CAO Qixin. Global localization of explorer based on visible landmarks[J]. Journal of Shanghai Jiao Tong University, 2009,43(6):871-874.
[14] SHAIK N, LUTZ M, SCHLEGEL C. 2D localization in large areas using inexpensive rgbd camera augmented with visual tags[C]//Proceedings of the 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA). Vienna, Austria: IEEE, 2020.
[15] 王家恩, 肖献强. 基于QR码视觉定位的移动机器人复合导航方法研究[J]. 仪器仪表学报, 2018,39(8):230-238. WANG Jiaen, XIAO Xianqiang. Mobile robot integrated navigation method based on QR code vision positioning[J]. Chinese Journal of Scientific Instrument,2018,39(8):230-238.
[16] ITO S, ENDRES F, KUDERER M, et al. W-RGB-D: floor-plan-based indoor global localization using a depth camera and wifi[C]//Proceedings of 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China: IEEE 2014:417-422.
[17] HEANG S Y, SONG J B. Monocular vision-based global localization using position and orientation of ceiling features[C]//Proceedings of 2013 IEEE International Conference on Robotics and Automation (ICRA). Karlsruhe, Germany: IEEE, 2013: 3785-3790.
[18] 杨晶东, 彭坤, 顾浩楠, 等. 基于直线特征的机器人自主定位方法[J]. 上海交通大学学报, 2018,52(9):1120-1124. YANG Jingdong, PENG Kun, GU Haonan, et al. Autonomous localisation method based on linear feature for robots[J]. Journal of Shanghai Jiao Tong University,2018,52(9):1120-1124
[19] GOTO T, PATHAK S, JI Y et al. Line-based global localization of a spherical camera in manhattan worlds[C]//Proceedings of 2018 IEEE International Conference on Robotics and Automation (ICRA). Brisbane, QLD, Australia: IEEE, 2018:2296-2303.
[20] TAN F, YANG J, HUANG J, et al. A corner and straight line matching localization method for family indoor monitor mobile robot[C]//Proceedings of 2010 IEEE International Conference on Information and Automation(ICIA). Harbin, China: IEEE, 2010:1902-107.
[21] WANG X, MARCOTTE R J, OLSON E. GLFP: global localization from a floor plan[C]//Proceedings of 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).Macau, China: IEEE, 2019:1627-1632.
[22] 刘今越, 唐旭, 贾晓辉, 等. 基于面元的机器人三维激光雷达室内实时定位和建图方法[J]. 仪器仪表学报, 2020,41(7):99-106. LIU Jinyue, TANG Xu, JIA Xiaohui, et al. Surfel-based indoor real time localization and mapping method using 3D lidar for robot[J]. Chinese Journal of Scientific Instrument, 2020,41(7):99-106.
[23] WIETRZYKOWSKI J, SKRZYPCZYNSKI P. PlaneLoc: probabilistic global localization in 3D using local planar features[J]. Robotics and Autonomous Systems, 2019,113:160-173.
[24] HAN J, KIM J. DAVID H. Precise localization and mapping in indoor parking structures via parameterized SLAM[J]. IEEE Transactions on Intelligent Transportation Systems, 2019,20(12):4415-4426.
[25] WU Z, YUE Y, WEN M, et al. Infrastructure-free hierarchical mobile robot global localization in repetitive environments[J]. IEEE Transactions on Instrumentation and Measurement, 2021(70):1-12.
[26] 李磊, 朱铭琳, 杨国胜, 等. 基于门牌号识别的移动机器人全局自定位方法研究[J]. 高技术通讯, 2003(8):71-76. LI Lei, ZHU Minglin, YANG Guosheng, et al. Research on the global self-localization based on the doorplate recognition for mobile robot[J]. Chinese High Technology Letters, 2003(8):71-76.
[27] CHEN R, YIN H, JIAO Y, et al. Deep samplable observation model for global localization and kidnapping[J]. IEEE Robotics and Automation Letters, 2021,6(2):2296-2303.
[28] MANTELLI M, PITTOL D, NEULAND R, et al. A novel measurement model based on abBRIEF for global localization of a UAV over satellite images[J]. Robotics and Autonomous Systems, 2019,112:304-319.
[29] RATZ S, DYMCZYK M, SIEGWART R, et al. Oneshot global localization: instant lidar-visual pose estimation[C]//Proceedings of 2020 IEEE International Conference on Robotics and Automation (ICRA). Paris France: IEEE, 2020: 5415-5421.
[30] WHITAKER J, CHRISTENSEN R, DROGE, G. Global localization of ground vehicles using self-describing fiducials coupled with IMU data[C]//Proceedings of 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS). Portland, OR, USA: IEEE, 2020:186-196.
[31] YE Qin, SHI Pengcheng, XU Kunyuan, et al. A novel loop closure detection approach using simplified structure for low-cost lidar[J]. Sensors (Switzerland), 2020, 20(8): 2299.
[32] SHI Pengcheng, YE Qin, ZENG Lingwen. A novel indoor structure extraction based on dense point cloud[J]. ISPRS Int. J. Geo-Information, 2020, 9(11): 660.