You are currently viewing a new version of our website. To view the old version click .
Sensors
  • Hypothesis
  • Open Access

24 August 2021

Indoor Positioning Using Magnetic Fingerprint Map Captured by Magnetic Sensor Array

,
,
and
1
Department of Computer Science and Information Engineering, National Central University, Taoyuan 32001, Taiwan
2
Department of English, Wenzao Ursuline University of Languages, Kaohsiung 80793, Taiwan
3
Undergraduate Program in College of Electrical Engineering and Computer Science, Chung Yuan Christian University, Taoyuan 32023, Taiwan
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Indoor Magnetic-Based Positioning System

Abstract

By collecting the magnetic field information of each spatial point, we can build a magnetic field fingerprint map. When the user is positioning, the magnetic field measured by the sensor is matched with the magnetic field fingerprint map to identify the user’s location. However, since the magnetic field is easily affected by external magnetic fields and magnetic storms, which can lead to “local temporal-spatial variation”, it is difficult to construct a stable and accurate magnetic field fingerprint map for indoor positioning. This research proposes a new magnetic indoor positioning method, which combines a magnetic sensor array composed of three magnetic sensors and a recurrent probabilistic neural network (RPNN) to realize a high-precision indoor positioning system. The magnetic sensor array can detect subtle magnetic anomalies and spatial variations to improve the stability and accuracy of magnetic field fingerprint maps, and the RPNN model is built for recognizing magnetic field fingerprint. We implement an embedded magnetic sensor array positioning system, which is evaluated in an experimental environment. Our method can reduce the noise caused by the spatial-temporal variation of the magnetic field, thus greatly improving the indoor positioning accuracy, reaching an average positioning accuracy of 0.78 m.

1. Introduction

Location-based service (LBS) is a value-added service that uses positioning technology to precisely provide user location information. Because this service can provide the most direct advertisements, weather information, according to the user’s current location, makes it of great commercial value. Typical positioning methods can be roughly divided into indoor and outdoor applications, according to the field of use. Global navigation satellite systems (GPS) are often implemented for outdoor positioning, but GPS signals are greatly attenuated when obstructed by obstacles, which makes it hard to apply to indoor positioning. Conversely, the commonly used indoor positioning solutions are based on the sensing devices used, such as Wi-Fi [1], Bluetooth [2], laser rangefinder [3], visual orientation [4], etc. The advantage of Wi-Fi/Bluetooth positioning technology is that the wireless positioning operation has a wide range, and the deployment can be arranged according to the needs of users, but the disadvantage is that the minimum cost of placement is high, and the interference between the object under test and the landmark is easy to cause positioning deviation [5,6]. The laser rangefinder positioning method is currently the most commonly used positioning method for the automatic navigation of indoor unmanned vehicles. The unmanned vehicle with the laser rangefinder can construct the map and achieve the purpose of coordinate positioning during the movement; the advantage is that the cost of deployment is low, and the positioning accuracy is high, but the disadvantage is that the cost of this technology is high. As for visual orientation, this technology uses cameras to measure the distance between objects, calculating their latent information; its advantage is having high accuracy, but the disadvantage is that the positioning range is limited by the camera’s viewing angle and distance, therefore it is not suitable for large-scale positioning tasks. Moreover, it is easily affected by light, causing it to perform unstably in conditions in which light changes drastically.
Compared with the above-mentioned traditional indoor positioning method, the magnetic field has the characteristic of no interference by the movement of a crowd and does not require additional hardware deployment, thus it has great potential for indoor positioning [7,8,9]. The magnetic field is an innate resource of the earth, but when it passes through the steel structure in the building and various electrical equipment each location in the room will have its own different magnetic field data. Therefore, as long as we use these unique magnetic field features to build a dataset (fingerprint map) in advance, we can use it for indoor positioning and navigation purposes. There are several papers published that also suggest this promising usage of magnetic field positioning, such as accurate magnetic indoor localization using deep learning [10], multi-view graph [11], and reliability-augmented particle filter [12]. The current magnetic field positioning technology mainly uses the fingerprinting method [10,11,12,13,14] by comparing each point in the room. This method needs to split the indoor environment into a grid and consequently collect the magnetic field information of each point. When the user is positioning, the magnetic field information collected by the sensor is matched with the information of the fingerprint map, such that the location of the user can be accurately found. However, since the magnetic field is easily affected by geomagnetic storms, the current magnetic field positioning technology is mostly combined with other indoor positioning technologies such as Wi-Fi [15] or inertial sensor (IMU) [12] to improve the accuracy.
This research proposes a high-performance indoor positioning system using a magnetic sensor array. We use three MMC5883MA magnetic sensors to build a magnetic sensor array and develop a low-complexity recurrent probabilistic neural network classifier [16] on the embedded platform “STM32F767ZI” to calculate the position information, and finally complete a high-accuracy, low-power consumption indoor positioning system. In this system, we use the Kalman filter to filter out the environmental noise of the magnetic field signal output by our magnetic sensor array and calculate the differentiation computation value between the sensors to reduce the influence of the time changing of the indoor magnetic field. This allows us to obtain stable and effective magnetic field characteristic information. Compared with other indoor positioning technologies, the classifier architecture used by the system also has the advantages of low-complexity and low-power consumption and is suitable for application in low-cost electronic products.

3. Magnetic Sensor Array Indoor Positioning System

The indoor positioning system based on the magnetic sensor array described in this research is integrated with the STM32F767 Nucleo-144 development platform as shown in Figure 4. The magnetic sensor array system is used to collect the magnetic field information of the environment in order to calculate magnetic field features, such as magnetic field X/Y/Z components, magnetic field strength, magnetic inclination, and magnetic declination, etc. We also perform differentiation computation on the data measured by each sensor to obtain feature values that can reduce the time-varying influence.
Figure 4. Embedded magnetic sensing array development platform.
The magnetic sensor array indoor positioning system is composed of three magnetic sensors MMC5883MA; the distance between the sensors is 5 cm, and the three sensors are arranged in an L-shape. The sensor will return the collected magnetic field information to the MCU STM32F767 Nucleo-144 development platform through the I2C communication interface for signal processing and magnetic field feature value calculation, and finally sent to the recurrent probabilistic neural network classifier to estimate the coordinates of the location. Figure 5 shows the design and prototype of the magnetic sensor array indoor positioning system.
Figure 5. Magnetic sensor array indoor positioning system: (a) design and (b) prototyping.

3.1. Pre-Processing of Signals

The magnetic field information output by the MMC5883MA sensor will have certain noise that results in unstable changes in the output signal; therefore, after initializing the MMC5883MA Magnetic sensor, we will first use the Kalman filter to process the output of the X/Y/Z magnetic field components, which are collected by the sensors. Finally, we can obtain a more stable magnetic field output information.
Besides the magnetic field X/Y/Z components, magnetic field strength, magnetic inclination, and magnetic declination, and the magnetic field features mentioned above, we also include the differentiation computation values measured by three sensors in the sensor array: M1, M2, M3, in order to obtain the differentiation feature. For the X component, the calculation of differentiation includes Mx1−Mx2, Mx1−Mx3, and Mx2−Mx3; Y component are My1−My2, My1−My3, andMy2−My3; and Z component are Mz1−Mz2, Mz1−Mz3, and Mz2−Mz3. These form the magnetic feature vector at each location.

3.2. Build the Magnetic Field Database

Before conducting indoor positioning, we use the magnetic sensor array system to collect the magnetic field data of different indoor positions in a specific building and consequently establish a fingerprint database of the indoor magnetic field, which is used to form a fingerprint map. For magnetic field data collection, we divide the indoor space into grids, as shown in Figure 6, and then sequentially collect the magnetic field information of each coordinate point and save it in the database.
Figure 6. Divide the room into grids to create a magnetic field database.
Figure 7 is a schematic diagram of using the magnetic sensor array system to collect the magnetic field data of the indoor space in Figure 6 and estimate the indoor magnetic field intensity distribution based on the information of the sampling point. From this experiment, it can be concluded that the indoor magnetic field in the building does verify from each space, creating a set of unique features due to the fixture of the building and the indoor facilities, and the range is about 30 to 60 µT. Therefore, the magnetic field strength of each indoor location can be regarded as a significant feature in the indoor environment and can be used in indoor positioning applications.
Figure 7. Schematic diagram of indoor magnetic field distribution.

3.3. Estimation of Position Coordinates

We used RPNN to construct a recognition model for inferencing the position coordinates by magnetic fingerprint map. This model is shown in Figure 8, called RPNN fingerprint map classifier (RFMC). The input vector of the RFMC includes the magnetic field strength, magnetic declination, magnetic inclination, magnetic field X/Y/Z components, and their differentiation captured by the magnetic sensor array. The magnetic fingerprint map will be placed into RFMC. After being processed by several hidden layers such as Gaussian layer, summation layer, and decision layer, it will output the position coordinates as shown in Figure 8.
Figure 8. RPNN fingerprint map classifier (RFMC).

4. Experimental Results and Discussion

4.1. Experiment of Magnetic Field Feature

The earth’s magnetic field is affected by the sun’s radiation, which will cause the magnetic field information measured at different times to be different. Therefore, we must first conduct experiments on the stability of the magnetic field features that were used.

4.1.1. Changes in Magnetic Field Strength at Different Times

We used the same magnetic sensor MMC5883MA to measure the magnetic information of a certain point in an indoor space at room temperature. We recorded once every 1 min from 8 pm on 4/22, 05/06, 05/20, for a total of 24 h, to collect the changes of magnetic field strength in the same environment within 14 days. As we can see in Figure 9, the waveform changes and morphology of magnetic field components X/Y/Z within 24 h are similar. The variation of the magnetic field intensity of the X-axis component was about 0.22 µT, and for the Y-axis component, it was about 0.25 µT. As for the Z-axis component, it was about 0.25 µT.
Figure 9. Changes in magnetic field strength collected 14 days apart by: (a) sensor X; (b) sensor Y; (c) sensor Z.

4.1.2. Measurement from Magnetic Sensor Array System

In order to ensure that the data from different sampling points collected by the sensors were unique and suitable for the usage of input features for indoor positioning, we used the magnetic sensor array system to sample at the same point. The magnetic field data was recorded once every 1 min for a total of 24 h. Next, we conducted differentiation computation of the X/Y/Z components output by the three magnetic sensors M1, M2, M3 in the magnetic sensor array to verify the stability of the value of the signal. After the computation, the value of the X component after the differentiation computation was about 0.15 µT, that of the Y component was about 0.1 µT, and that of Z component after the calculation was about 0.2 µT; each component of the magnetic field intensity captured by the magnetic sensor array was displayed after the differentiation computation, and we can see the value was stable, as shown in Figure 10.
Figure 10. Differentiation of each magnetic signal component pair collected by: (a) sensor X; (b) sensor Y; (c) sensor Z.
Next, we constructed a 4 × 4 grid area in a certain space of the building, with 16 sampling points in total; the length and width of the grid was 60 cm, as shown in Figure 11. Then we used the magnetic sensor array system proposed to collect the magnetic field information at each sampling point and performed the differentiation computation of the X/Y/Z components. The results are shown in Table 1. According to the data listed in Table 1, if the distance between two sampling points is only 60 cm, the differentiation calculations we used can remain stable and are distinguishable, which allows us to use it as a magnetic field feature.
Figure 11. Sampling points arrangement.
Table 1. The differentiation calculation of the magnetic field strength of the grid sampling points in a small area.

4.2. Experiment of Sensor Array Positioning

4.2.1. Simulate Environment

In this experiment, we used the corridor and hall in our laboratory as our experimental environment, as shown in Figure 12. The length of the laboratory corridor was 46 m, and magnetic field information was collected every 60 cm. Twenty data items were collected at each sampling point, for a total of 1540 data items. The length and width of the hall were 11.4 m and 6.6 m, respectively, and the total area was 75.24 square meters. We divided it into 20 × 12 grids and collected magnetic field information every 60 cm and collected 20 data at each sampling point. A total of 4800 magnetic fields were collected to build a fingerprint database.
Figure 12. Floor plan of the first floor of the building.

4.2.2. Configuration of RPNN Fingerprint Map Classifier

In the experimental environment described in Section 4.2.1, the day after we collected and established the magnetic fingerprint database, we recollected the magnetic field data at the same sampling points in the lobby and corridor of the building. Two data were collected at each coordinate point. As for the test data for indoor positioning, it was used to verify the accuracy of the RPNN fingerprint map classifier (RFMC) for location recognition. In order to confirm the optimal smoothing parameter of the RFMC, we selected the classifier models established with the smoothing parameters of 0.3, 0.2, and 0.1 to perform the position recognition experiment. The results are shown in Table 2. From the experimental results of Table 2, it can be seen that no matter where the test field is, the best result is under the condition that the smoothing parameter of the RFMC is set to less than 0.2. However, if the smoothing parameter is set to 0.1, the maximum error will be slightly increased compared to the setting of 0.2. Therefore, for the RFMC, the best choice of smoothing parameters is between 0.1 and 0.2.
Table 2. Performance comparison of different smoothing parameters for RFMC.

4.2.3. Comparison of Positioning Accuracy between Single Sensor and Sensor Array

In this experiment, we set a rectangular test path in the hall to compare the results of the indoor positioning accuracy of a single magnetic sensor and a magnetic sensor array. Figure 13 is the result of using a single sensor. The average error was 1.17 m, the maximum error reached 5.07 m.
Figure 13. Indoor positioning experiment by single magnetic sensor.
When we used the X/Y/Z components, magnetic field strength, magnetic inclination angle, and magnetic declination angle collected by this sensor array as the input vector of the RFMC, the result performed better than that of using a single sensor. The mean error of the experimental results was 0.83 m, and the maximum error was 1.91 m as shown in Figure 14.
Figure 14. Indoor positioning experiment of magnetic sensor array.
Figure 15 shows the inference result of RPNN fingerprint map classifier (RFMC) for experimental indoor positioning. This time, we added a new feature, the differentiation computation between the three sensors. In this testing experiment, the prediction result of the RFMC was almost identical to the authentic path. The average error of the experimental results was 0.73 m, and the maximum error was 1.73 m. It can be known from the above experiments that the magnetic sensor array in this research can definitely improve the positioning accuracy compared with the single magnetic sensor. In addition, if we impose the differentiation calculations to the information collected by the three sensors, the positioning accuracy can be boosted further as shown in Table 3.
Figure 15. Indoor positioning experiment of sensor array with differentiation features.
Table 3. Accuracy comparison of different configurations of RFMC.

4.3. The Comparison of the Accuracy of Different Positioning Methods

Compared with other methods of positioning, the method of using convolutional neural network (CNN) algorithms to classify hybrid location images, which use Wi-Fi and magnetic field fingerprints to establish, the mean error of the result was 1.7 m, and 90% of the error was maintained within 5.6 m [12]. As for indoor positioning using reliability-augmented particle filter (RAPF). The average error of the experimental field established by this research was 1 m, and the 80% error was maintained within 1.8 m. The AMID [10] method obtained the mean error at 1.7 m with 90% error maintained within 5.6 m. The other method, called MVG [11], obtained a mean error of 2 m without the deviation rate data. As for the sensor array proposed by this research, combined with the RFMC, the average error was 0.73 m, and 90% of the error could be maintained within 1 m, showing that the proposed method has good accuracy and good stability; Table 4 shows the accuracy comparison.
Table 4. Accuracy comparison of different magnetic-based positioning methods.

5. Conclusions

At present, the magnetic field positioning technology mainly uses the magnetic field fingerprint comparison method to locate. By collecting the magnetic field information of each spatial point, we can build a magnetic field fingerprint map. When the user is positioning, the magnetic field measured by the sensor is matched with the magnetic field fingerprint map to identify the user’s location. However, since the magnetic field is easily affected by external magnetic fields and magnetic storms, which can lead to “local temporal-spatial variation”, this makes it difficult to construct a stable and accurate magnetic field fingerprint map. This research has built a magnetic sensor array to capture the spatial magnetic differentiation for indoor positioning. We propose a new magnetic indoor positioning method, RPNN fingerprint map classifier (RFMC), which uses a recurrent probabilistic neural network (RPNN) to perform real-time learning and inferencing. The magnetic sensor array can detect subtle magnetic anomalies and spatial variations to improve the stability and accuracy of magnetic field fingerprint maps, and the RFMC model is built for recognizing the magnetic field fingerprint. We can finally implement an embedded magnetic sensor array positioning system that was evaluated in an experimental environment. Our method can reduce the noise caused by the spatial-temporal variation of the magnetic field, thus greatly improve the indoor positioning accuracy, reaching an average positioning accuracy of 0.78 m.
As the demand for indoor positioning has attracted more attention, increasing research has proposed various methods of indoor positioning. However only a cost-less technique can be prevalent on the market. As we widely apply indoor positioning to commercial use, the development of our society can improve dramatically. A clear example is large shopping malls. Once shopping malls apply indoor positioning, it can not only reduce the chance of customers getting lost, but also collect their movement data. We can predict that, in the foreseeable future, our living can be more facilitated. This is also the reason we want to use magnetic fields as our major feature to build a model. As long as we can reduce the cost of implementing indoor positioning, more companies and industries will be willing to introduce this technology to their services.

Author Contributions

Conceptualization, C.-H.C.; methodology, T.-H.L.; software, P.-W.C. and P.-J.C.; validation, P.-W.C., P.-J.C. and T.-H.L.; formal analysis, C.-H.C.; investigation, C.-H.C.; resources, T.-H.L.; data curation, C.-H.C.; writing—original draft preparation, P.-W.C. and P.-J.C.; writing—review and editing, T.-H.L.; visualization, P.-W.C. and P.-J.C.; supervision, C.-H.C.; project administration. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

There is no statement from the Institutional Review Board.

Data Availability Statement

We have listed all the references we used in our research down below our manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, H.; Darabi, H.; Banerjee, P.; Liu, J. Survey of wireless indoor positioning techniques and systems. IEEE Trans. Syst. 2007, 37, 1067–1080. [Google Scholar]
  2. Palumbo, F.; Barsocchi, P.; Chessa, S.; Augusto, J.C. A atigmergic approach to indoor localization using bluetooth low energy beacons. In Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Karlsruhe, Germany, 25–28 August 2015; pp. 1–6. [Google Scholar]
  3. Dissanayake, G.; Newman, P.; Clark, S.; Durrant-Whyte, H.; Csorba, M. A solution to the simultaneous localization and map building (SLAM) problem. IEEE Trans. Robot. Autom. 2001, 17, 229–241. [Google Scholar] [CrossRef] [Green Version]
  4. Karlsson, N.; di Bernardo, E.; Ostrowski, J.; Goncalves, L.; Pirjanian, P.; Munich, M.E. The vSLAM algorithm for robust localization and mapping. In Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 18–22 April 2005; pp. 24–29. [Google Scholar]
  5. Pivato, P.; Palopoli, L.; Petri, D. Accuracy of RSS-Based Centroid Localization Algorithms in an Indoor Environment. IEEE Trans. Instrum. Meas. 2011, 60, 3451–3460. [Google Scholar] [CrossRef] [Green Version]
  6. Wang, L.; Hon, T.-K.; Reiss, J.D.; Cavallaro, A. Self-Localization of Ad-Hoc Arrays Using Time Difference of Arrivals. IEEE Trans. Signal Process. 2015, 64, 1018–1033. [Google Scholar] [CrossRef]
  7. Saxer, U.P.; Barbakow, J.; Yankell, S.L. New studies on estimated and actual toothbrushing times and dentifrice use. J. Clin. Dent. 1998, 9, 49–51. [Google Scholar] [PubMed]
  8. Pasku, V.; Angelis, A.D.; Angelis, G.D.; Arumugam, D.D.; Dionigi, M.; Carbone, P.; Moschitta, R.A.; Ricketts, D.S. Magnetic field-based positioning systems. IEEE Commun. Surv. Tutor. 2017, 19, 2003–2017. [Google Scholar] [CrossRef]
  9. Mu, X.; Qian, J.; Xu, C.; Pei, L.; Liu, P.; Yu, W. Magnetic Field Based Indoor Pedestrian Positioning Using Self-contained Sensors. In Proceedings of the China Satellite Navigation Conference (CSNC) 2017, Shanghai, China, 23–25 May 2017. [Google Scholar] [CrossRef]
  10. Lee, N.; Ahn, S.; Han, D. AMID: Accurate Magnetic Indoor Localization Using Deep Learning. Sensors 2018, 18, 1598. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Liu, Z.; Cheng, L.; Liu, A.; Zhang, L.; He, X.; Zimmermann, M. Multiview and Multimodal Pervasive Indoor Localization. In Proceedings of the 25th ACM international conference on Multimedia, New York, NY, USA, 19 October 2017; pp. 109–117. [Google Scholar]
  12. Xie, H.; Gu, T.; Tao, X.; Ye, H.; Lu, J. A reliability-augmented particle filter for magnetic fingerprinting based indoor localization on smartphone. IEEE Trans. Mob. Comput. 2016, 15, 1877–1892. [Google Scholar] [CrossRef]
  13. Kim, B.; Kong, S.-H. A Novel Indoor Positioning Technique Using Magnetic Fingerprint Difference. IEEE Trans. Instrum. Meas. 2016, 65, 2035–2045. [Google Scholar] [CrossRef]
  14. Chung, J.; Donahoe, M.; Schmandt, C.; Kim, I.J.; Razavai, P.; Wiseman, M. Indoor location sensing using geo-magnetism. In Proceedings of the ACM International Conference on Mobile Systems, Applications, and Services, New York, NY, USA, 28 June–1 July 2011; pp. 141–154. [Google Scholar]
  15. Shu, Y.; Bo, C.; Shen, G.; Zhao, C.; Li, L.; Zhao, F. Magicol: Indoor localization using pervasive magnetic field and oppor-tunistic WiFi sensing. IEEE J. Sel. Areas Commun. 2015, 33, 1443–1457. [Google Scholar] [CrossRef]
  16. Specht, D. Probabilistic neural networks and the polynomial Adaline as complementary techniques for classification. IEEE Trans. Neural Netw. 1990, 1, 111–121. [Google Scholar] [CrossRef] [PubMed]
  17. Moon, Y.-S.; Whang, K.-Y.; Loh, W.-K. Efficient time-series subsequence matching using duality in constructing windows. Inf. Syst. 2001, 26, 279–293. [Google Scholar] [CrossRef]
  18. Chen, C.-H.; Wang, C.-C.; Chen, Y.-Z. Intelligent Brushing Monitoring Using a Smart Toothbrush with Recurrent Probabilistic Neural Network. Sensors 2021, 21, 1238. [Google Scholar] [CrossRef] [PubMed]
  19. Shao, W.; Luo, H.; Zhao, F.; Ma, Y.; Zhao, Z.; Crivello, A. Indoor Positioning Based on Fingerprint-Image and Deep Learning. IEEE Access 2018, 6, 74699–74712. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.