Multi-Level Fusion Indoor Positioning Technology Considering Credible Evaluation Analysis
Abstract
:1. Introduction
- Aiming at the problems of a single data type and poor robustness in traditional localization, a multi-dimensional feature fusion localization method based on deep learning is proposed. A deep convolutional neural network-assisted denoising variational autoencoder (DVAE-CNN) localization model is designed. The latent feature extraction and fusion are carried out on the multi-dimensional electromagnetic signal map including pseudolite, Wi-Fi and geomagnetic information in the indoor environment. Finally, by establishing the mapping relationship between the multi-dimensional deep features and the spatial position, the absolute position estimation of the target in the indoor environment is realized.
- Aiming at the problems of the poor continuity and low reliability of positioning results caused by the occlusion and interference of indoor positioning signals, a credible evaluation and analysis method based on the combination of an unsupervised autoencoder and particle filter is proposed. The multi-source heterogeneous data quality evaluation model, geographic prior information and MEMS sensor information are effectively integrated, and the positioning performance is improved by constraining the particle state transition equation and weight update method.
- In order to verify the performance of the positioning method, a large number of experiments were carried out in the test field environmen. Finally, the effectiveness of the proposed multi-level fusion positioning’s trusted positioning was verified, and a high-precision positioning better than 1 m (90%) was achieved. At the same time, the proposed method was successfully applied to the large stadiums of the 2022 Beijing Winter Olympics, providing continuous high-precision location services for security, epidemic prevention and other operation teams, and promoting the development of indoor positioning industrialization.
2. Related Work
3. Method
3.1. Multi-Dimensional Electromagnetic Atlas Fusion Positioning Technology
3.1.1. Information Collection and Electromagnetic Atlas Construction
3.1.2. Positioning Model Construction and Training
Algorithm 1: Positioning Model Training Process |
Input: Multi-dimensional radio signal map; Position coordinates(x,y). Output: Locator model B. 1: Data preprocessing (data normalization, input data interception, adding noise, data-level division including training, testing and validation data); 2: while encoder model learning do 3: Initialize the deep learning network DVAE-CNN model, set hyperparameters, etc.; 4: Load the training data level into the DVAE-CNN model; 5: Calculate the mean and variance of the distribution and then sample the latent variable z; 6: Obtain the reconstructed data through the decoder; 7: Calculate the error between the model reconstructed data and the original data; 8: Determine whether the model has converged to the set threshold. If the conditions are met, set the early stop mechanism to end the training. If not, go to step 6; 9: Fine-tune the network, update the parameters using the backpropagation algorithm and repeat steps 4–6 until the model converges; 10: Save encoder model A; 11: while locator model learning do 12: Initialize the localization model parameters consisting of model A and convolutional classification network; 13: Model training by model A and (x,y), if the convergence conditions are met, stop early, if not, repeat step 9; 14: Save locator model B. |
3.1.3. Positioning Model Encapsulation and Call
3.2. Credible Evaluation System Design
3.2.1. Credible Assessment of Data Quality of Multi-Dimensional Electromagnetic Atlases
3.2.2. Credible Evaluation of Prior Geographic Information Assistance
Algorithm 2: Credibility Evaluation System Design |
Input: Multi-dimensional electromagnetic data x, dimension of the atlas M, particle number n, particle step size , particle direction, credible evaluation threshold ; Output: Reconstruction error e; reliable localization result . 1: Initialization: Randomly generate a group of particles according to certain rules; preprocessing of multi-dimensional electromagnetic atlas; build the credibility evaluation model and initialize the model parameters; 2: The encoder model is trained by using the multi-dimensional electromagnetic atlas x to obtain the credibility evaluation model matching the dataset; 3: Use to evaluate the real-time data x; 4: if the reconstruction error e satisfies the credible evaluation threshold then 5: Execute step 7; 6: else propose the data x at the current moment, and repeat step 3; 7: Using the multi-dimensional data x and positioning model to obtain real-time positioning results ; 8: while a new motion measurement do 9: for each particle do 10: Update the current position by the following equation the position at time is , the position coordinate at time is , the distance traveled before and after time is by Equation (13) and is the random movement direction of the particle; 11: Update the weight information by the equation , where is the particle state at the current moment and is the measurement deviation. 12: if particles pass through building walls then 13: Set the weight of the corresponding particle to 0, that is, to eliminate possible abnormal positions; 14: end if 15: if the number of particles is less than the set threshold then 16: Resample: Generate a new set of particles by roulette sampling; 17: end if 18: Obtain the current positioning result through the particle state and weight; 19: end for 20: end while |
4. Discussion
4.1. Characteristic Analysis of Positioning Model in Laboratory Environment
4.1.1. Construction of Multi-Dimensional Electromagnetic Atlas
4.1.2. Model Training and Performance Comparison
4.1.3. Analysis on the Effectiveness of Credible Evaluation Methods
4.1.4. Fusion Positioning Performance Evaluation
4.2. Positioning Performance Analysis in Real Application Scenarios
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Huang, L.; Li, H.; Yu, B.; Gan, X.; Wang, B.; Li, Y.; Zhu, R. Combination of smartphone MEMS sensors and environmental prior information for pedestrian indoor positioning. Sensors 2020, 20, 2263. [Google Scholar] [CrossRef] [Green Version]
- Alarifi, A.; Al-Salman, A.; Alsaleh, M.; Alnafessah, A.; Al-Hadhrami, S.; Al-Ammar, M.A.; Al-Khalifa, H.S. Ultra wideband indoor positioning technologies: Analysis and recent advances. Sensors 2016, 16, 707. [Google Scholar] [CrossRef] [Green Version]
- Ijaz, F.; Yang, H.K.; Ahmad, A.W.; Lee, C. Indoor positioning: A review of indoor ultrasonic positioning systems. In Proceedings of the 2013 15th International Conference on Advanced Communications Technology (ICACT), PyeongChang, Korea, 27–30 January 2013; pp. 1146–1150. [Google Scholar]
- Basiri, A.; Lohan, E.S.; Moore, T.; Winstanley, A.; Peltola, P.; Hill, C.; e Silva, P.F. Indoor location based services challenges, requirements and usability of current solutions. Comput. Sci. Rev. 2017, 24, 1–12. [Google Scholar] [CrossRef] [Green Version]
- Billa, A.; Shayea, I.; Alhammadi, A.; Abdullah, Q.; Roslee, M. An overview of indoor localization technologies: Toward IoT navigation services. In Proceedings of the 2020 IEEE 5th International Symposium on Telecommunication Technologies (ISTT), Shah Alam, Malaysia, 9–11 November 2020; pp. 76–81. [Google Scholar]
- Shang, S.; Wang, L. Overview of WiFi fingerprinting-based indoor positioning. IET Commun. 2022, 16, 725–733. [Google Scholar] [CrossRef]
- Ren, Y.; Salim, F.D.; Tomko, M.; Bai, Y.B.; Chan, J.; Qin, K.K.; Sanderson, M. D-Log: A WiFi Log-based differential scheme for enhanced indoor localization with single RSSI source and infrequent sampling rate. Pervasive Mob. Comput. 2017, 37, 94–114. [Google Scholar] [CrossRef]
- Yang, T.; Cabani, A.; Chafouk, H. A Survey of Recent Indoor Localization Scenarios and Methodologies. Sensors 2021, 21, 8086. [Google Scholar] [CrossRef] [PubMed]
- Witrisal, K.; Hinteregger, S.; Kulmer, J.; Leitinger, E.; Meissner, P. High-accuracy positioning for indoor applications: RFID, UWB, 5G, and beyond. In Proceedings of the 2016 IEEE International Conference on RFID (RFID), Orlando, FL, USA, 3–5 May 2016; pp. 1–7. [Google Scholar]
- Pascacio, P.; Casteleyn, S.; Torres-Sospedra, J.; Lohan, E.S.; Nurmi, J. Collaborative indoor positioning systems: A systematic review. Sensors 2021, 21, 1002. [Google Scholar] [CrossRef]
- Mandal, A.; Lopes, C.V.; Givargis, T.; Haghighat, A.; Jurdak, R.; Baldi, P. Beep: 3D indoor positioning using audible sound. In Proceedings of the Second IEEE Consumer Communications and Networking Conference, CCNC, Las Vegas, NV, USA, 6 January 2005; pp. 348–353. [Google Scholar]
- Rossi, M.; Seiter, J.; Amft, O.; Buchmeier, S.; Tröster, G. RoomSense: An indoor positioning system for smartphones using active sound probing. In Proceedings of the 4th Augmented Human International Conference, New York, NY, USA, 7–8 March 2013; pp. 89–95. [Google Scholar]
- Kim, H.G.; Kim, G.Y. Deep neural network-based indoor emergency awareness using contextual information from sound, human activity, and indoor position on mobile device. IEEE Trans. Consum. Electron. 2020, 66, 271–278. [Google Scholar] [CrossRef]
- Faragher, R.; Harle, R. An analysis of the accuracy of bluetooth low energy for indoor positioning applications. In Proceedings of the 27th International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS+ 2014), Tampa, FL, USA, 8–12 September 2014; pp. 201–210. [Google Scholar]
- Subhan, F.; Hasbullah, H.; Rozyyev, A.; Bakhsh, S.T. Indoor positioning in bluetooth networks using fingerprinting and lateration approach. In Proceedings of the 2011 International Conference on Information Science and Applications, Jeju, Korea, 26–29 April 2011; pp. 1–9. [Google Scholar]
- Puckdeevongs, A.; Tripathi, N.K.; Witayangkurn, A.; Saengudomlert, P. Classroom attendance systems based on Bluetooth Low Energy Indoor Positioning Technology for smart campus. Information 2020, 11, 329. [Google Scholar] [CrossRef]
- Bocquet, M.; Loyez, C.; Benlarbi-Delai, A. Using enhanced-TDOA measurement for indoor positioning. IEEE Microw. Wirel. Compon. Lett. 2005, 15, 612–614. [Google Scholar] [CrossRef]
- Zhou, Z. An Overview of Ultra-Wideband Positioning Technology and Its Applications. In SHS Web of Conferences; EDP Sciences: Paris, France, 2022; Volume 144, p. 02001. [Google Scholar]
- Alamu, O.; Iyaomolere, B.; Abdulrahman, A. An overview of massive MIMO localization techniques in wireless cellular networks: Recent advances and outlook. Ad Hoc Netw. 2021, 111, 102353. [Google Scholar] [CrossRef]
- Huang, L.; Yu, B.; Li, H.; Zhang, H.; Li, S.; Zhu, R.; Li, Y. HPIPS: A high-precision indoor pedestrian positioning system fusing WiFi-RTT, MEMS, and map information. Sensors 2020, 20, 6795. [Google Scholar] [CrossRef] [PubMed]
- Li, C.T.; Cheng, C.P.; Chen, K. Top 10 technologies for indoor positioning on construction sites. Autom. Constr. 2020, 118, 103309. [Google Scholar] [CrossRef]
- Farid, Z.; Nordin, R.; Ismail, M. Recent advances in wireless indoor localization techniques and system. J. Comput. Netw. Commun. 2013, 2013, 185138. [Google Scholar] [CrossRef]
- Poulose, A.; Eyobu, S.; Han, D.S. A combined PDR and Wi-Fi trilateration algorithm for indoor localization. In Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan, 11–13 February 2019; pp. 72–77. [Google Scholar]
- Diaz, E.M.; Ahmed, D.B.; Kaiser, S. A review of indoor localization methods based on inertial sensors. Geogr. Fingerpr. Data Creat. Syst. Indoor Position Indoor/Outdoor Navig. 2019, 2019, 311–333. [Google Scholar]
- Ouyang, G.; Abed-Meraim, K. A Survey of Magnetic-Field-Based Indoor Localization. Electronics 2022, 11, 864. [Google Scholar] [CrossRef]
- Luo, R.C.; Hsu, W.L. Robust Indoor Localization Using Histogram of Oriented Depth Model Feature Map for Intelligent Service Robotics. IEEE/ASME Trans. Mechatron. 2022, 27, 4033–4044. [Google Scholar] [CrossRef]
- Huang, L.; Gan, X.; Yu, B.; Zhang, H.; Li, S.; Cheng, J.; Wang, B. An innovative fingerprint location algorithm for indoor positioning based on array pseudolite. Sensors 2019, 19, 4420. [Google Scholar] [CrossRef] [Green Version]
- Yu, X.; Feng, X.; Deng, Z. Research on Indoor Positioning Algorithm Based on Pseudolites. Radio Eng. 2020, 50, 85–89. [Google Scholar]
- Gan, X.; Yu, B.; Wang, X.; Yang, Y.; Jia, R.; Zhang, H.; Wang, B. A new array pseudolites technology for high precision indoor positioning. IEEE Access 2019, 7, 153269–153277. [Google Scholar] [CrossRef]
- Shum, L.C.; Faieghi, R.; Borsook, T.; Faruk, T.; Kassam, S.; Nabavi, H.; Iaboni, A. Indoor Location Data for Tracking Human Behaviours: A Scoping Review. Sensors 2022, 22, 1220. [Google Scholar] [CrossRef] [PubMed]
- Alhammadi, A.; Hashim, F.; Rasid, A.M.F.; Alraih, S. A three-dimensional pattern recognition localization system based on a Bayesian graphical model. Int. Ournal Distrib. Sens. Netw. 2020, 16, 1550147719884893. [Google Scholar] [CrossRef]
- Arigye, W.; Pu, Q.; Zhou, M.; Khalid, W.; Tahir, M.J. RSSI Fingerprint Height Based Empirical Model Prediction for Smart Indoor Localization. Sensors 2022, 22, 9054. [Google Scholar] [CrossRef] [PubMed]
- Kuang, J.; Niu, X.; Zhang, P.; Chen, X. Indoor positioning based on pedestrian dead reckoning and magnetic field matching for smartphones. Sensors 2018, 18, 4142. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Birkel, U.; Weber, M. Indoor localization with UMTS compared to WLAN. In Proceedings of the 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sydney, NSW, Australia, 13–15 November 2012; pp. 1–6. [Google Scholar]
- Song, W.; Lee, H.; Lee, S.H.; Choi, M.H.; Hong, M. Implementation of android application for indoor positioning system with estimote BLE beacons. J. Internet Technol. 2018, 19, 871–878. [Google Scholar]
- Xia, H.; Zuo, J.; Liu, S.; Qiao, Y. Indoor localization on smartphones using built-in sensors and map constraints. IEEE Trans. Instrum. Meas. 2018, 68, 1189–1198. [Google Scholar] [CrossRef]
- Gusenbauer, D.; Isert, C.; Krösche, J. Self-contained indoor positioning on off-the-shelf mobile devices. In Proceedings of the 2010 International Conference on Indoor Positioning and Indoor Navigation, Zurich, Switzerland, 15–17 September 2010; pp. 1–9. [Google Scholar]
Model | Hyperparameters | Values of Parameters |
---|---|---|
DVAE-CNN | Input Size | 25 × 25 (according to map) |
Convolutional layer | 3 × 3 filter size, stride = 2 | |
Latent_dim | 20 | |
Activation Function | ReLU (rectified liner unit) | |
Number of Convolutional Layers | 2 | |
Pooling Size | 2 | |
Dropout | 0.5 | |
Number of FC Layers | 2 | |
Optimizer | Adam | |
Learning Rate | 0.0001 | |
Batch Size | 32 | |
Epochs | 500 (EarlyStopping, patience = 10, verbose = 1) | |
Classification Layer | Input Size | Latent_dim (20,1) |
Convolutional layer | Filter size = 32, kernel size = 5 | |
Max pooling1D | Pool size = 5 | |
Dropout | 0.03 | |
Number of FC Layers | 7 | |
Loss | Mean_squared_error | |
Optimizer | Adam (7 × 10−4) | |
Activation Function | ReLU (Rectified Liner Unit) |
Different Methods | Positioning Accuracy Using Different Methods (m) | ||
---|---|---|---|
Maximum | Minimum | Mean | |
AE + Classifier | 6.00 | 0.03 | 2.35 |
VAE + Classifier | 5.12 | 0.04 | 2.28 |
AE-CNN | 3.62 | 0.05 | 1.29 |
VAE-CNN | 2.71 | 0.03 | 1.18 |
Our method | 2.70 | 0.03 | 1.07 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Huang, L.; Yu, B.; Du, S.; Li, J.; Jia, H.; Bi, J. Multi-Level Fusion Indoor Positioning Technology Considering Credible Evaluation Analysis. Remote Sens. 2023, 15, 353. https://doi.org/10.3390/rs15020353
Huang L, Yu B, Du S, Li J, Jia H, Bi J. Multi-Level Fusion Indoor Positioning Technology Considering Credible Evaluation Analysis. Remote Sensing. 2023; 15(2):353. https://doi.org/10.3390/rs15020353
Chicago/Turabian StyleHuang, Lu, Baoguo Yu, Shitong Du, Jun Li, Haonan Jia, and Jingxue Bi. 2023. "Multi-Level Fusion Indoor Positioning Technology Considering Credible Evaluation Analysis" Remote Sensing 15, no. 2: 353. https://doi.org/10.3390/rs15020353