Tightly-coupled integration of acoustic signal and MEMS sensors on smartphones for indoor positioning

doi:10.11947/j.AGCS.2021.20200551

Abstract

Abstract: Based on the built-in sensors of a smartphone, a tightly-coupled integrated indoor positioning solution was developed based on the acoustic ranging signal and measurements from other built-in sensors. First, a two-step time of arrival (TOA) estimation method based on short-time Fourier transform and enhanced cross-correlation is performed to achieve an accurate TOA estimate. Having obtained the accurate TOA estimates, studies on a tightly-coupled integrated navigation algorithm based on TDOA and PDR is carried out. The algorithm takes the advantage of the complementarity of PDR and acoustic ranging observables to effectively improve positioning accuracy in a dynamic positioning scenario. In order to evaluate the performance of the proposed algorithm, field tests for static case and dynamic case were carried out. In the static test case, an average positioning accuracy of 0.238 m was achieved with an improvement of 38.66% compared to the least square solution purely based on acoustic ranging observables. For the dynamic test case, a method based on predicted state of Doppler compensation was applied for Doppler corrections of the TDOA observables. Furthermore, asynchronous TOA compensation, which caused by the fact that TOA measurements are not estimated in the same epoch, was also applied before feeding to the positioning algorithm. The test results demonstrated that positioning accuracy in dynamic case is 0.513 m. Compared to the solution without applying the Doppler corrections and the asynchronous TOA compensations, the performance is improved by 27.64%. Three mobile phones (Huawei Mate 20, OnePlus 6 and Google Pixel 3) were used in the field test, the performance of the positioning algorithm is consistence in all three different phones.

Key words: indoor localization, smartphone, acoustic signal, pedestrian dead reckoning, multi-source fusion

CLC Number:

P228

CHEN Ruizhi, GUO Guangyi, YE Feng, QIAN Long, XU Shihao, LI Zheng. Tightly-coupled integration of acoustic signal and MEMS sensors on smartphones for indoor positioning[J]. Acta Geodaetica et Cartographica Sinica, 2021, 50(2): 143-152.

References

[1] 陈锐志, 陈亮. 基于智能手机的室内定位技术的发展现状和挑战[J]. 测绘学报, 2017, 46(10):1316-1326. DOI:10.11947/j.AGCS.2017.20170383. CHEN Ruizhi, CHEN Liang. Indoor positioning with smartphones:the state-of-the-art and the challenges[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(10):1316-1326. DOI:10.11947/j.AGCS.2017.20170383.
[2] 李清泉, 周宝定, 马威, 等. GIS辅助的室内定位技术研究进展[J]. 测绘学报, 2019, 48(12):1498-1506. DOI:10.11947/j.AGCS.2019.20190455. LI Qingquan, ZHOU Baoding, MA Wei, et al. Research process of GIS-aided indoor localization[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(12):1498-1506. DOI:10.11947/j.AGCS.2019.20190455.
[3] KOIVISTO M, TALVITIE J, COSTA M, et al. Joint cmWave-based multiuser positioning and network synchronization in dense 5G networks[C]//Proceedings of 2018 IEEE Wireless Communications and Networking Conference (WCNC). Barcelona, Spain:IEEE, 2018.
[4] GUO Guangyi, CHEN Ruizhi, YE Feng, et al. Indoor smartphone localization:a hybrid WiFi RTT-RSS ranging approach[J]. IEEE Access, 2019, 7:176767-176781.
[5] CHEN Ruizhi, PEI Ling, CHEN Yuwei. A smart phone based PDR solution for indoor navigation[C]//Proceedings of the 24th International Technical Meeting of the Satellite Division of the Institute of Navigation. Portland, OR:ION, 2011.
[6] 陈国良, 张言哲, 汪云甲, 等. WiFi-PDR室内组合定位的无迹卡尔曼滤波算法[J]. 测绘学报, 2015, 44(12):1314-1321. DOI:10.11947/j.AGCS.2015.20140691. CHEN Guoliang, ZHANG Yanzhe, WANG Yunjia, et al. Unscented Kalman filter algorithm for WiFi-PDR integrated indoor positioning[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(12):1314-1321. DOI:10.11947/j.AGCS.2015.20140691.
[7] 吴东金, 夏林元. 面向室内WLAN定位的动态自适应模型[J]. 测绘学报, 2015, 44(12):1322-1330. DOI:10.11947/j.AGCS.2015.20130780. WU Dongjin, XIA Linyuan. Dynamic adaptive model for indoor WLAN localization[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(12):1322-1330. DOI:10.11947/j.AGCS.2015.20130780.
[8] CHEN Liang, PEI Ling, KUUSNIEMI H, et al. Bayesian fusion for indoor positioning using bluetooth fingerprints[J]. Wireless Personal Communications, 2013, 70(4):1735-1745.
[9] CAO Zhipeng, CHEN Ruizhi, GUO Guangyi, et al. iBaby:a low cost BLE pseudolite based indoor baby care system[C]//Proceedings of 2018 Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS). Wuhan, China:IEEE, 2018.
[10] HÖFLINGER F, ZHANG Rui, HOPPE J, et al. Acoustic self-calibrating system for indoor smartphone tracking (ASSIST)[C]//Proceedings of 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN). Sydney, NSW, Australia:IEEE, 2012.
[11] LIU Kaikai, LIU Xinxin, LI Xiaolin. Guoguo:enabling fine-grained smartphone localization via acoustic anchors[J]. IEEE Transactions on Mobile Computing, 2016, 15(5):1144-1156.
[12] LIU Mengyun, CHEN Ruizhi, LI Deren, et al. Scene recognition for indoor localization using a multi-sensor fusion approach[J]. Sensors, 2017, 17(12):2847.
[13] RUOTSALAINEN L, KUUSNIEMI H, BHUIYAN M Z H, et al. A two-dimensional pedestrian navigation solution aided with a visual gyroscope and a visual odometer[J]. GPS Solutions, 2013, 17(4):575-586.
[14] KUANG Jian, NIU Xiaoji, ZHANG Peng, et al. Indoor positioning based on pedestrian dead reckoning and magnetic field matching for smartphones[J]. Sensors (Basel), 2018, 18(12):4142.
[15] GUO Guangyi, CHEN Ruizhi, YE Feng, et al. A pose awareness solution for estimating pedestrian walking speed[J]. Remote Sensing, 2019, 11(1):55.
[16] CHEN Ruizhi, CHEN Wei, CHEN Xiang, et al. Sensing strides using EMG signal for pedestrian navigation[J]. GPS Solutions, 2011, 15(2):161-170.
[17] KHALEGHI B, KHAMIS A, KARRAY F O, et al. Multisensor data fusion:a review of the state-of-the-art[J]. Information Fusion, 2013, 14(1):28-44.
[18] WANG Hucheng, LUO Xiaonan, ZHONG Yanru, et al. Acoustic signal positioning and calibration with IMU in NLOS environment[C]//Proceedings of the 2019 Eleventh International Conference on Advanced Computational Intelligence (ICACI). Guilin, China:IEEE, 2019.
[19] PENG Chunyi, SHEN Guobin, ZHANG Yongguang. BeepBeep:a high-accuracy acoustic-based system for ranging and localization using COTS devices[J]. ACM Transactions on Embedded Computing Systems, 2012, 11(1):1-29.
[20] ZHOU Bing, ELBADRY M, GAO Ruipeng, et al. BatMapper:acoustic sensing based indoor floor plan construction using smartphones[C]//Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. Niagara Falls, NY, USA:ACM, 2017.
[21] TUNG Y C, SHIN K G. Expansion of human-phone interface by sensing structure-borne sound propagation[C]//Proceed-ings of the 14th Annual International Conference on Mobile Systems, Applications, and Services. Singapore:ACM, 2016.
[22] BUTTERWORTH S. On the theory of filter amplifiers[J]. The Wireless Engineer, 1930, 7(6):536-541.
[23] LEVI R W, JUDD T. Dead reckoning navigational system using accelerometer to measure foot impacts:US, 5583776[P]. 1996-12-10.
[24] 钱久超. 基于无约束自包含传感器的行人室内定位技术研究[D]. 上海:上海交通大学, 2016. QIAN Jiuchao. Research on indoor pedestrian positioning technology based on unrestricted self-contained sensors[D]. Shanghai:Shanghai Jiao Tong University, 2016.
[25] KALMAN R E. A new approach to linear filtering and prediction problems[J]. Journal of Basic Engineering, 1960, 82(1):35-45.
[26] HOSHIYA M, SAITO E. Structural identification by extended Kalman filter[J]. Journal of Engineering Mechanics, 1984, 110(12):1757-1770.