Next Article in Journal
2-D Joint Sparse Reconstruction and Micro-Motion Parameter Estimation for Ballistic Target Based on Compressive Sensing
Next Article in Special Issue
Dynamic Displacement Estimation for Long-Span Bridges Using Acceleration and Heuristically Enhanced Displacement Measurements of Real-Time Kinematic Global Navigation System
Previous Article in Journal
Closed-Loop Elastic Demand Control under Dynamic Pricing Program in Smart Microgrid Using Super Twisting Sliding Mode Controller
Previous Article in Special Issue
Space State Representation Product Evaluation in Satellite Position and Receiver Position Domain
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Testing Multi-Frequency Low-Cost GNSS Receivers for Geodetic Monitoring Purposes

Faculty of Civil and Geodetic Engineering, University of Ljubljana, Jamova Cesta 2, 1000 Ljubljana, Ljubljana
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(16), 4375; https://doi.org/10.3390/s20164375
Submission received: 7 July 2020 / Revised: 27 July 2020 / Accepted: 3 August 2020 / Published: 5 August 2020
(This article belongs to the Special Issue GNSS Signals and Sensors)

Abstract

:
Global Navigation Satellite System (GNSS) technology is widely used for geodetic monitoring purposes. However, in cases where a higher risk of receiver damage is expected, geodetic GNSS receivers may be considered too expensive to be used. As an alternative, low-cost GNSS receivers that are cheap, light, and prove to be of adequate quality over short baselines, are considered. The main goal of this research is to evaluate the positional precision of a multi-frequency low-cost instrument, namely, ZED-F9P with u-blox ANN-MB-00 antenna, and to investigate its potential for displacement detection. We determined the positional precision within static survey, and the displacement detection within dynamic survey. In both cases, two baselines were set, with the same rover point equipped with a low-cost GNSS instrument. The base point of the first baseline was observed with a geodetic GNSS instrument, whereas the second baseline was observed with a low-cost GNSS instrument. The results from static survey for both baselines showed comparable results for horizontal components; the precision was on a level of 2 mm or better. For the height component, the results show a better performance of low-cost instruments. This may be a consequence of unknown antenna calibration parameters for low-cost GNSS antenna, while statistically significant coordinates of rover points were obtained from both baselines. The difference was again more significant in the height component. For the displacement detection, a device was used that imposes controlled movements with sub-millimeter accuracy. Results, obtained on a basis of 30-min sessions, show that low-cost GNSS instruments can detect displacements from 10 mm upwards with a high level of reliability. On the other hand, low-cost instruments performed slightly worse as far as accuracy is concerned.

1. Introduction

The natural as well as built environment is continuously subjected to various forces in nature that may cause alterations in the shape and size of the environment. In some cases, those deformations may lead to damage and safety-of-life hazards. In order to prevent the worst-case scenario, manmade structures and natural hazards are monitored with geodetic sensors and methods on a basis of repeated geodetic surveys [1,2]. Traditionally, sensors and methods of terrestrial geodesy have usually been applied, however, with the availability and development of satellite geodesy, especially Global Navigation Satellite Systems (GNSS); the latter has also been recognized as a methodology for deformation monitoring [3,4,5].
The possibility to work continuously, remotely, in real-time, or with post-processing has resulted in a wide use of GNSS technology for geodetic monitoring [3,4]. In general, high-precision, but expensive GNSS receivers are used to determine 3D displacements. In cases of different construction objects, such as bridges, dams, and viaducts, the geodetic GNSS receivers have been shown to be suitable in terms of accuracy and have been classified as proper sensors for geodetic monitoring [3,4,5,6,7,8,9]. A study in [5] emphasized that geodetic receivers were accurate enough for estimating displacement in case of dam monitoring, however, compared to the pendulum, where a long observation period is considered, geodetic GNSS receivers were inferior.
Although geodetic receivers meet the quality criteria for monitoring tasks, their high price calls their use into question where there is a higher risk of instrument damage. An alternative solution may be seen in using low-cost GNSS receivers that have been shown to achieve high accuracy over short baselines [10,11,12,13,14].

1.1. Overview

In monitoring natural hazards and manmade structures, various geodetic methods may be used. Low-cost GNSS technology provides an inexpensive and flexible solution for geodetic monitoring purposes, especially when open-source software is considered [13,15]. Moreover, the GNSS data are reliable enough to be combined with other sensors to build up an early warning system for monitoring purposes [16].
The current number of scientific research regarding low-cost GNSS receivers is very limited. Only a few papers have been published that have investigated the potential and applicability of the low-cost receivers for geodetic monitoring purposes. In general, the performance of single-frequency, low-cost GNSS receivers was tested and analyzed in open-sky environments with reduced multipath impact. Low-cost GNSS receivers were usually set up as rover stations, whereas the geodetic, low-cost receiver, or virtual reference station (VRS) were used as base stations [11,12,14,17]. Studies showed that results based on low-cost GNSS receivers were promising for both static and kinematic mode [12,17]. Biagi et al. [12] tested the accuracy of the single-frequency u-blox NEO-7P receivers and the results indicated that horizontal displacements of 15 mm can be detected when a geodetic receiver is used as a base station. On the other hand, the results on a basis of u-blox NEO-7P receivers only (both base station and rover) were less accurate, but still satisfactory considering that few centimeter movements are expected in monitoring natural hazards. Two-dimensional displacements in range of 25 mm and 3D displacements in range of 35 mm were detected by low-cost receivers only. Caldera et al. [11] analyzed the performance of u-blox EVK-6T receivers in open-sky, for short baselines, using only GPS data. The results indicated that 3D displacements on a level of few millimeters can be detected in daily sessions. Using VRS as a base station reduces baseline length and, consequently, the positional accuracy is improved. Cina and Piras [14] analyzed baseline with VRS as base station and low-cost u-blox EVK-5T receiver in combination with a geodetic external antenna as a rover and obtained positional accuracy on a sub-cm level.
NEO-M8P, a single-frequency receiver, was used with Trimble Bullet 360° antenna for monitoring real-time kinematic (RTK) and post-processing mode, where GNSS data were processed with open-source software and the entire monitoring station was built with low costs [13]. RTK positional accuracy was on a level of 4 and 8 mm for the horizontal and vertical component, respectively. The results were further improved with post-processing and the accuracy for hourly sessions was estimated to be 2 and 5 mm for horizontal and vertical component, respectively [13]. The same single-frequency receiver was also tested by Garrido-Carretro et al. [18] in RTK mode with low-cost antennae over short baseline (350 m). The results using single-base RTK solution indicate accuracy of 5.5 mm for the horizontal component and 11 mm for the vertical component.
Nowadays, multi-frequency, low-cost GNSS receivers are also available at the market. This type of GNSS receiver can receive satellite signals in both L1 and L2 frequencies from all available satellite constellations. Gebre-Egziaber [10] tested multi-frequency receiver Piksi Multi and the mid-range receiver Eclipse P307 in static and dynamic applications. Both receivers performed well compared with the results obtained from the geodetic receiver, used as a reference. ZED-F9P GNSS module in combination with a patch antenna reached centimeter accuracy in 3D positioning. Similar results were obtained when an external Trimble R10 antenna was applied [19]. Lastly, low-cost dual-frequency receivers in combination with different antennas were used by Krietemeyer et al. [20] for the estimation of Zenith Tropospheric Delay (ZTD). When relative calibration parameters for antennae were applied, the results indicated that the ZTD was estimated with a comparable accuracy with results obtained from the geodetic antennas. To date, mostly single-frequency low-cost receivers were used for displacement detection or geodetic monitoring, while in this study we tested the potential of multi-frequency low-cost receivers for displacements detection which proved satisfactory performance in open sky.

1.2. Objective and Organization of the Work

In this study, a multi-frequency low-cost receiver ZED-F9P and u-blox GNSS antenna ANN-MB-00 were analyzed. GNSS data were obtained in favorable conditions in open-sky environment where reduced impact of multipath is expected. The main objective is to evaluate the positional quality of the low-cost receivers and to identify the minimum level of displacements that can be detected with such inexpensive instruments.
The paper is structured as follows: firstly, an overview of the usage of single- and double-frequency, low-cost receivers for geodetic monitoring is described (Section 1). Then, the configuration and connection of the simpleRTK2B board with OpenLog are shown. Basic statistics are adopted to evaluate the positional quality of ZED-F9P, hypotheses are tested to define the range of displacements that can be detected (Section 2). Obtained results are presented and discussed (Section 3). Lastly, conclusions and remarks are presented (Section 4).

2. Material and Methods

2.1. Low-Cost GNSS Receiver ZED-F9P

Nowadays, different types of multi-frequency GNSS receivers that are cheap, light, and able to work in static and dynamic applications are available. At the beginning of 2019, the u-blox company launched the ZED-F9P chip that can receive satellite signals in the lower and upper-L band (L1C/A, L1OF, E1, B1l, L2C, L2OF, E5b, B2l) from all available satellite constellations (GPS, GLONASS, Galileo, BeiDou) [21]. The u-blox integrated the ZED-F9P module in C099-F9P application board that can work in RTK mode and transmit RTCM corrections via cable, Wi-Fi, or Bluetooth and is easily configurable through the open-source evaluation software u-center [21,22]. Another board that houses the ZED-F9P chip is simpleRTK2B offered by Ardusimple. The board and u-blox multiband antenna ANN-MB-00 can be purchased with low cost (270 EUR). SimpleRTK2B can be also configured by u-center and has the same GNSS chip with an integrated RTK engine, which enables coordinate estimation in real-time. Both boards that own a ZED-F9P chip may be a proper solution for geodetic monitoring of natural hazards, however, they should first be tested in an optimal environment to analyze their performance.

2.2. SimpleRTK2B Board and OpenLog Connection

Two SimpleRTK2B boards together with u-blox GNSS antennas ANN-MB-00 were used in our case study (Figure 1a). In the initial phase of the experiment, simpleRTK2B boards were connected with the laptop, where the USB port was used for power supply as well as for data storage. However, it turned out that the laptop was not an adequate solution, since its battery ran out after three hours. The bad weather conditions were also not a positive factor for using laptop. Instead, we used Sparkfun’s OpenLog DEV-13955 for data storage. It was connected to the simpleRTK2B with jumper wires (Figure 1b). The OpenLog can send all messages that come from RX1/TX1 pin to the mounted MicroSD. The TX1 pin of the board needs to be connected with the RX1 pin of the OpenLog to transmit messages, 5V_OUT pin, and the IOREF pin was connected with the VCC pin to define the voltage and the GND pin to GND pin [23,24]. OpenLog can work with MicroSD that has a memory capacity from 512 MB up to 32 GB. Two lights are flashing during operation, one continuously for communication, and the other one when the OpenLog records data in MicroSD [24].
The boards were configured with the u-center evaluation software to output messages through the UART1 port. The baud rate was set to 115,200—the recommended value for the 9th generation of u-blox GNSS receivers. To get observations in RINEX format, RXM-RAWX and RXM-SFRBX messages were enabled in UART1. The data were stored in the UBX file that was converted to RINEX by using the modified version (demo5_b33b) of the RTKLIB. Since the version of RTKLIB developed by Tomoji Takasu had difficulties converting the UBX file to the RINEX file, we decided to use the modified version developed by Tim Everett that is used for converting UBX files and data processing [25,26]. To ensure power supply, two power banks Platinet PMPB20TW with 20,000 mAh5V capacity were used. The energy consumption of the SimpleRTK2B, antenna, and OpenLog is pretty low (215 mAh in total); the survey can therefore last for approximately 90 h.

2.3. Study Area

The roof of the Faculty of Civil and Geodetic Engineering—University of Ljubljana (UL FGG) building was selected as the location for the experiment (Figure 2). The roof represents generic conditions and is equipped with concrete pillars that enable force centering of GNSS instruments. The iron plates on the top of the pillars may be seen as a ground plane during the observations, which is recommended in the case of patch antennas [27]. On the other hand, the coordinates of the pillars are known, as they were determined from several longer static GNSS surveys in the past. Low-cost antennas are very sensitive to multipath error and additionally, phase center offset and variations are unknown. The latter has an impact on the results, especially in the height component [12]. To mitigate the multipath error, an open-sky environment was selected (roof of the faculty), while the missing antenna calibration issue will be addressed in the future.
Geodetic receiver Leica GS 15 with integrated antenna LEIGS15 NONE was put on the pillar FGG2 (Figure 3a), while two low-cost receivers were placed on pillars FGG1 and FGG4 (Figure 2). GNSS receiver in point FGG1 (Figure 3b) is used as a rover, where the other two are used as reference stations. Spatial distance defined between FGG2 and FGG1 is 65 m, and in the upcoming tests, we refer to this baseline as the G-baseline. The abbreviation G represents geodetic GNSS receiver Leica GS 15 (base). The second baseline, denoted as L-baseline, is 18 m long and was observed with two low-cost receivers, i.e., the base is also a low-cost receiver.

2.4. Evaluation Approach of ZED-F9P

The evaluation approach of the GNSS module ZED-F9P includes two aspects, namely, the positional quality and investigation of its potential for displacement detection. Firstly, static observations are carried out to analyze the reliability of GNSS data and to assess the quality of multi-frequency, low-cost instrument positioning. Secondly, controlled movements of the low-cost antenna are imposed to analyze the minimum level of displacement that may be detected with low-cost GNSS instruments.

2.4.1. Positional Quality

To evaluate the positional quality of ZED-F9P, static observations were carried out at 1 Hz for 28 h from the 31st to 34th day of the year 2020 (from 31st January until 3rd February), where data from three different navigation systems, namely, GPS, GLONASS, and Galileo, were obtained. GNSS data were processed with open-source software RTKLIB (demo5_b33b) in hourly sessions. The processing parameters used in RTKLIB are shown in Table 1. The number of satellites was at least 15 in every session for both baselines. We initially used also Leica Infinity for processing of the GNSS data, but since it processed data from L1 frequency only and somehow ignored all L2 observations, we did not use it in further analysis.
The results of GNSS data processing were estimated coordinates of the FGG1 point; for each hourly session the mean value of obtained coordinates was calculated, for both baselines, the G-baseline and the L-baseline. Baseline residuals were used to obtain some elementary statistics, such as minimum and maximum value, and Root–Mean–Square–Error (RMSE). No outliers were detected in GNSS data; all residuals were in the interval less than 3σ, where the verification was done by τ-test and Tukey’s Method [28,29]. Residuals were, in most cases, less than 4 mm for all coordinate components (Y—east, X—north, and h—ellipsoidal height). To better express their differences, we followed a classification adopted from Biagi et al. [12], where five groups were defined. The first group represents all residuals in a range from 0 to 2 mm, the second from 2 to 4 mm, the third from 4 to 6 mm, the fourth from 6 to 8 mm, and the last one from 8 to 10 mm.
Because GNSS data from two baselines were processed, two triplets of FGG1 coordinates were obtained for each session. One set of coordinates belongs to the G-baseline, denoted as YG, XG, and hG, and the other one to the L-baseline, denoted as YL, XL, and hL. The differences of estimated 1D, 2D and, 3D positions from both (L- and G-) baselines are determined as
b 1 = h L h G
b 2 = ( Y L Y G ) 2 + ( X L X G ) 2
b 3 = ( Y L Y G ) 2 + ( X L X G ) 2 + ( h L h G ) 2
The differences in estimated coordinates from Equations (1)–(3) are mainly due to different GNSS instruments at both base stations, the geodetic GNSS receiver/antenna at FGG2 and low-cost GNSS receiver/antenna at FGG4 [12]. To compare the performance of different GNSS instruments at both base stations, the analysis of variance (ANOVA) is applied separately for each coordinate component (Y, X, and h). ANOVA is used to identify if there is a significant difference between the means of two groups, i.e., means of FGG1 coordinates obtained from both baselines [30]. The comparison of coordinate means is done by defining the following hypotheses:
H0: The use of different types of GNSS instruments doesn’t affect coordinates;
Ha: The use of different types of GNSS instruments affects coordinates.
Results of the positional analysis are presented in the first part of Section 3, namely, in Section 3.1.

2.4.2. Displacement Detection

To analyze the possibility of displacement detection, a mechanical device (Figure 4) that can impose controlled movements with sub-millimeter accuracy in the horizontal plane was used. The rover antenna was placed on a specially designed iron ground plane with a 15-cm diameter mounted on the device (Figure 4), which has already been proved to improve the results of the survey with low-cost antennae [20].
Measurements were performed from 52nd until 55th day of the year 2020 (from 21st February until 24th February), with sampling rate set to 1 Hz. The survey consisted of a series of 30-min sessions, where the rover was moved by 5 mm in-between two consecutive sessions. All movements were imposed in horizontal plane only. According to Günter et al. [31], 30-min sessions can be considered as suitable for detecting displacements. The same survey was then repeated for all the following days and, as a result, 270 displacements, classified into 10 groups, were obtained. The first group represents a displacement of 5 mm, the second a displacement of 10 mm, the third of 15 mm, and so on. The last, 10th, group is represented with a displacement of 50 mm. Consecutive groups are therefore mutually different for 5 mm, from 5 up to 50 mm. This classification is done to analyze the minimum value of displacements which can be detected by using only low-cost instruments or low-cost instruments in combination with geodetic receivers on base station.
In order to determine if the displacements of the rover are significant, statistical tests are applied [28,32,33,34]. To test point stability between two different sessions, the following hypotheses are used:
H0: d = 0 ; Point remained stable between two sessions;
Ha: d 0 ; Point did not remain stable between two sessions—the displacement is detected.
The test statistic that is used to verify the rejection of the null hypothesis is defined as follows [34]
T = d σ d  
The verification of the null hypothesis is done by comparing calculated test values with the critical values. The test is dependent on the displacement dimension, i.e., for 1D, 2D, or 3D (see Equations (1)–(3)), however, the significance level of 5% (α = 0.05) was set for all cases [34]. The displacement between two sessions, session i and session j ( j i ), for all three dimensions (1D, 2D, and 3D) is as follows
d 1 = Δ h = h j h i
d 2 = Δ Y 2 + Δ X 2 = ( Y j Y i ) 2 + ( X j X i ) 2
d 3 = Δ Y 2 + Δ X 2 + Δ h 2 = ( Y j Y i ) 2 + ( X j X i ) 2 + ( h j h i ) 2
where:
Y i , X i , h i —FGG1 coordinates from the i th session;
Y j , X j , h j —FGG1 coordinates from the j th session.
Based on the error propagation law, the variance of the considered displacements was estimated as follows [35]
σ d 2 = J d Σ i j J d T  
Jacobi matrices ( J d ) , design matrices in case of error propagation law, are defined for 1D, 2D, and 3D displacements, respectively [33]
J d 1 = [ d 1 h i d 1 h j ]
J d 2 = [ d 2 Y i   d 2 X i   d 2 Y j   d 2 X j ]
J d 3 = [ d 3 Y i   d 3 X i   d 3 h i   d 3 Y j   d 3 X j   d 3 h j ]
Variance–covariance matrices ( Σ i j ) for all three dimensions have the following form [33]
1 D :   Σ i j = [ σ h i 2 0 0 σ h j 2 ]
2 D :   Σ i j = [ σ Y i 2 σ Y i X i 0 0 σ Y i X i σ X i 2 0 0 0 0 σ Y j 2 σ Y j X j 0 0 σ Y j X j σ X j 2 ]
3 D :   Σ i j = [ σ Y i 2 σ Y i X i σ Y i h i 0 0 0 σ Y i X i σ X i 2 σ X i h i 0 0 0 σ Y i h i σ X i h i σ h i 2 0 0 0 0 0 0 σ Y j 2 σ Y j X j σ Y j h j 0 0 0 σ Y j X j σ X j 2 σ X j h j 0 0 0 σ Y j h j σ X j h j σ h j 2 ]
According to 1D test statistic from Equations (1), (9) and (12), the statistic is distributed with the standardized normal distribution. On the other hand, the 2D test statistic (Equations (2), (10) and (13)) and 3D test statistic (Equations (3), (11) and (14)) are distributed with χ2 distribution with 2 and 3 degrees of freedom [34].
Since the imposed displacements of the rover antenna were in the horizontal plane only, we expect the test statistic for all 1D displacement to be smaller than its critical value. To test if the ellipsoidal height has changed between two sessions, the following hypotheses are set:
H0: d 1 = 0 ; Point didn’t move vertically between two sessions;
Ha: d 1 0 ; Point moved vertically between two sessions—the vertical displacement is detected.
Rejection of the null hypothesis is verified based on the test statistic and critical value (tcritical = 1.96) determined from standardized normal distribution [34]. The null hypothesis was tested 720 times in total, for all possible pairs of sessions. The number of tests is much higher for 1D compared to both of the following cases (2D and 3D tests) because observations from positional quality assessment surveys (data from Section 2.4.1) were also used.
The horizontal coordinates of point FGG1 were also tested in order to detect horizontal displacement. During the survey, 270 possible displacements were imposed, which ranged from 5 to 50 mm. Differences between sessions of two identical positions were not tested. In this case, we are testing only differences that correspond to truly imposed displacements and may, therefore, determine the minimum level of the displacement for low-cost GNSS instruments. The following hypothesis are set:
H0: d 2 = 0 ; Point didn’t move horizontally between two sessions;
Ha: d 2 0 ; Point moved horizontally between session—the horizontal displacement is detected.
Verification of rejection of the null hypothesis is done by comparing test statistics with the critical value (tcritical = 2.45), determined from χ2 distribution with two degrees of freedom. The final critical value is determined as a square root of theoretical χ2 critical value.
In reality, the displacements of points are expected to be spatial (in 3D) in any direction. In this case, for 3D displacements, the following hypotheses are set:
H0: d 3 = 0 ; Point did not move spatially between two sessions;
Ha: d 3 0; Point moved spatially between two sessions—the spatial displacement is detected.
As in the case of 2D, 270 movements were imposed in total, where the defined critical value (tcritical = 2.80) is used to verify the rejection of tested hypotheses. This was again obtained from χ2 distribution with three degrees of freedom (and again a square root value). The procedure of displacements’ detection is shown graphically in Figure 5.
A mechanical device that imposes displacements provides them with sub-millimeter accuracy, and therefore true values of all displacements are known. In the horizontal plane, the displacements are in steps of 5 mm, from 0 to 50 mm, whereas in vertical directions there are truly no displacements, all their values are equal to 0 mm. For all estimated displacements (1D, 2D, and 3D), we also estimated Mean Absolute Error (MAE). In this way, important information will be acquired, namely, the level of accuracy of estimated displacements with respect to their true values that may be achieved with low-cost GNSS receivers. The MAE values will be determined for both baselines, for the G-baseline as well as for the L-baseline. The results are presented in the second part of the following Section 3.

3. Results and Discussions

This section represents the results of the methods defined in the previous section. The first part shows the assessment of the positional quality of low-cost GNSS receivers, whereas the second part represents displacement detection. In both cases, results will be presented for G-baseline as well as for L-baseline.

3.1. Positional Quality Assessment

Some elementary statistics for baseline residuals are presented in Table 2 (G-baseline) and Table 3 (L-baseline).
The RMSE values for both baselines, the G- and L-baseline, are comparable and are on a level of 2 mm or better for both horizontal components. However, for the vertical component, the RMSE value is slightly higher, especially for the G-baseline. Results show that in the case of L-baseline, the height component is determined with higher precision, as in the case of G-baseline. The reason may be found in unknown antenna phase center offset and variation in the low-cost GNSS antenna. Since the L-baseline has low-cost GNSS antennae for the base as well as for the rover, the bias of the missing antenna calibration is eliminated with single differences. On the other hand, for the G-baseline, which has a geodetic GNSS antenna, with known antenna calibration parameters, the missing calibration parameters affect the final results, especially the height component [12,20].
Figure 6 represents results from Table 2 and Table 3 in graphical form. Graphs in Figure 6 depicts baseline residuals for all coordinate components (Y, X, and h) and, for both baselines, the left graphs are for G-baseline, whereas the right graphs are for L-baseline.
All residuals were classified into five groups according to their absolute values, where the results are represented in Table 4 for G-baseline and in Table 5 for L-baseline. In the case of G-baseline, the residuals for both horizontal components are within 4 mm; only 3% of X residuals are in the third group. For the height component, 86% of them are within 6 mm, while the rest are equally represented in the 4th and 5th group. On the other hand, the results for the L-baseline are slightly worse, 3% of Y residuals and 6% of X residuals are in the third group. However, for the height component, the results are slightly better; all residuals are within 8 mm. This may again be due to the unknown antenna offset and phase variation bias in the case of low-cost antennae.
Differences in determined FGG1 coordinates from both tested baselines, namely, the G-baseline and L-baseline, are shown in Table 6. Differences in position arise mostly from the height component (10.4 mm), whereas the horizontal difference in position is only 2.6 mm. The difference in 3D position has been estimated with lower precision (5.2 mm), followed by 1D position (4.6 mm) while the difference in 2D position was estimated with higher precision (2.5 mm).
Table 7 represents the results of the ANOVA test, where the differences from Table 6 are analyzed. ANOVA test was performed with a significance level of 5%. The results of the test show that the null hypothesis was rejected for all three components and may confirm that using different GNSS instrument types (geodetic vs. low-cost) will significantly affect estimated baseline components [12]. The difference is again much larger for the height component. Again, the reason for this may be in uncalibrated low-cost GNSS antenna.

3.2. Displacement Detection Results

Within this section, the results of displacement detections are represented. Statistical tests were performed to detect displacements in height component (1D tests), where the results are shown in Table 8, in horizontal plane (2D tests), where the results are represented in Table 9 and for spatial displacements (3D tests), where the results are represented in Table 10.
Because the imposed displacements were in the horizontal plane only, we should fail to reject the null hypothesis in all cases of statistical tests for 1D displacement detection. The results from Table 8 show that this is true in 98% cases for the G-baseline but only in 77% cases for the L-baseline. This result is interesting; it shows that the height component is determined with higher accuracy in the case of the G-baseline compared to the L-baseline when the true value of zero displacement is considered. In the precision determination, the RMSE of the L-baseline was shown to be smaller than the G-baseline (see previous Section 3.1), while in detecting 1D displacements the height component obtained from G-baseline was more accurate, as shown in Table 8. The reason for these results may be found in missing antenna calibration parameters for low-cost antennae, but the performance of low-cost receivers and antennae may also account for that.
In the case of horizontal displacements, Table 9 presents the number of successfully determined displacements of size 10, 15, and 20 mm. The results for 5 mm displacements are not shown, since none of the two tested baselines were able to reliably detect 5 mm displacement in a high percentage (less than 90%). On the other hand, displacements greater than 20 mm are not presented, because all of them were reliably detected.
Results from Table 9 are based on 270 statistical tests that were done for all possible differences between sessions where displacement was imposed. We may see that displacements of 10 mm and onward are all successfully detected on a basis of 30-min sessions and in favorable conditions. In real situations, we may experience a decrease in the rate of successfully detected displacements due to the impact of obstacles, multipath, bad weather conditions, etc. [11,12].
The 3D case is just a combination of 1D and 2D cases, so the results in Table 10 are very similar to the 2D case. However, a slight drop (3%) in detected displacements for the L-baseline of 10 mm displacement is due to the error in height component (see Table 8).
Figure 7 represents graphically results from Table 8, Table 9 and Table 10, where differences between true and estimated displacement in all three dimensions, i.e., 1D, 2D, and 3D, are shown. True displacements were always zero for 1D case and in steps of 5 mm for 2D and 3D cases. There are 720 calculated displacements in the case of 1D and 270 calculated displacements for 2D and 3D cases. In 1D cases, the variation in differences is larger, while for 2D and 3D cases, it is slightly smaller.
The last table, Table 11, represents MAE values, the averages of absolute values, calculated for all data from Figure 7. The lowest MAE is for both baselines determined for the 2D case, followed by the 3D case and the highest MAE is determined for the height component (1D). We have to emphasize here that the highest value of MAE is for 1D only because many more observations are used in this case. The number of 1D tests for displacement detection was 720 (static and dynamic test, see Section 2.4.2), whereas, in the 2D and 3D cases, the number of tests was only 270 (dynamic test only). However, we may also see that the G-baseline has a lower level of MAE for all three dimensions. The improvement in accuracy for the G-baseline over L-baseline is 20% for 1D, and 40% for 2D and 3D.
The results from Table 11 show that geodetic instruments had a better performance than low-cost GNSS instruments, despite the presence of antenna offset bias in G-baseline. This may indicate several factors, namely, worse quality of low-cost GNSS receiver, worse quality of low-cost external GNSS antenna, and the possibility that individual antenna calibration parameters should be determined for every low-cost GNSS antenna (type calibration does not represent all individual antennae). However, to fully understand all possible causes, additional tests and analysis must be done in the future. Some possible solutions may be seen in using different external antennae, performing individual relative antenna calibrations, or using an external antenna with known calibration data [14,20].

4. Conclusions

In geodetic monitoring, geodetic GNSS receivers and antennae are usually used as they provide high-quality results. However, in cases where there is high risk of instrument damage, these may be regarded as unsuitable. It is then more appropriate to use low-cost GNSS receivers/antennae. To date, those were usually single-frequency receivers, but recently double-frequency, low-cost receivers are also available at the market.
In this paper, we analyzed the positional quality and the potential for displacement detection of a ZED-F9P low-cost GNSS receiver in combination with an ANN-MB-00 low-cost GNSS antenna. The survey was done in favorable conditions where a static as well as dynamic survey was performed. The results obtained in this work lead to the following conclusions regarding the used low-cost equipment:
  • Geodetic GNSS receiver with a geodetic antenna and low-cost receiver with the low-cost antenna had slightly better performance but the positional quality of used low-cost GNSS equipment is well enough and accepted in applications such as geodetic monitoring of natural hazards;
  • 3D displacements in a range of 10 mm can be detected by using low-cost GNSS instrumentation with a high level of reliability in open sky;
  • 2D displacements were estimated with higher accuracy than 3D and 1D displacements, used antennas are non-calibrated and this probably influences the precision of displacements’ estimation, especially the vertical component;
  • SimpleRTK2B board is cheap, light, and easily configurable through the freely available u-center application software. Considering these characteristics and the proven performance, it can be classified as a proper sensor in few monitoring applications.
However, it should be noted here that all tests were performed in favorable surveying conditions and with short baselines. We expect that under adverse conditions the results would deteriorate. Therefore, it would be useful to perform additional tests in the future where several factors should be analyzed. One of them is adverse surveying conditions. On the other hand, to eliminate antenna bias, a calibrated GNSS antennae should also be used, with the possibility of individual antenna calibration parameters. Low-cost GNSS instruments should also be analyzed to separately determine the performance of receiver and antenna.

Author Contributions

Conceptualization, V.H. and B.S.; Methodology, V.H., O.S. and B.S.; software, V.H.; validation, V.H., O.S. and B.S.; formal analysis, V.H.; investigation, V.H.; data curation, V.H.; writing—original draft preparation, V.H.; writing—review and editing, V.H., O.S., T.A., G.T. and B.S; visualization, V.H.; supervision, O.S. and B.S. All authors have read and agreed to the published version of the manuscript.

Funding

The authors acknowledge the financial support from the Slovenian Research Agency—ARRS (research core funding No. P2-0227 Geoinformation infrastructure and sustainable spatial development of Slovenia and research core funding No. P2-0260 Structural mechanics).

Acknowledgments

We acknowledge Albin Mencin for the support in the fieldwork and Jernej Tekavec for sharing his experience with low-cost GNSS receivers.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ehrhart, M.; Lienhart, W. Monitoring of civil engineering structures using a state-of-the-art image assisted total station. J. Appl. Geod. 2015, 9. [Google Scholar] [CrossRef]
  2. Artese, G.; Perrelli, M.; Artese, S.; Manieri, F.; Principato, F. The contribute of geomatics for monitoring the great landslide of Maierato, Italy. In Proceedings of the ISPRS—International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Padua, Italy, 27–28 February 2013; Volume XL-5/W3, pp. 15–20. [Google Scholar]
  3. Kaloop, M.; Elbeltagi, E.; Hu, J.; Elrefai, A. Recent advances of structures monitoring and evaluation using gps-time series monitoring systems: A review. ISPRS Int. J. Geo-Inf. 2017, 6, 382. [Google Scholar] [CrossRef] [Green Version]
  4. Im, S.B.; Hurlebaus, S.; Kang, Y.J. Summary review of GPS technology for structural health monitoring. J. Struct. Eng. 2013, 139, 1653–1664. [Google Scholar] [CrossRef]
  5. Barzaghi, R.; Cazzaniga, N.E.; De Gaetani, C.I.; Pinto, L.; Tornatore, V. Estimating and comparing dam deformation using classical and GNSS techniques. Sensors 2016, 18, 756. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Yi, T.; Li, H.; Gu, M. Recent research and applications of GPS based technology for bridge health monitoring. Sci. China Technol. Sci. 2010, 53, 2597–2610. [Google Scholar] [CrossRef]
  7. Yu, J.; Yan, B.; Meng, X.; Shao, X.; Ye, H. Measurement of bridge dynamic responses using network-based real-time kinematic gnss technique. J. Surv. Eng. 2016, 142, 04015013. [Google Scholar] [CrossRef]
  8. Xiao, R.; Shi, H.; He, X.; Li, Z.; Jia, D.; Yang, Z. Deformation monitoring of reservoir dams using GNSS: An application to south-to-north water diversion project, China. IEEE Access 2019, 7, 54981–54992. [Google Scholar] [CrossRef]
  9. Yi, T.-H.; Li, H.-N.; Gu, M. Experimental assessment of high-rate GPS receivers for deformation monitoring of bridge. Measurement 2013, 46, 420–432. [Google Scholar] [CrossRef]
  10. Gebre-Egziabher, D. Evaluation of Low-Cost Centimter-Level Accuracy OEM GNSS Receivers. Available online: http://www.dot.state.mn.us/research/reports/2018/201810.pdf (accessed on 13 February 2020).
  11. Caldera, S.; Realini, E.; Barzaghi, R.; Reguzzoni, M.; Sansò, F. Experimental study on low-cost satellite-based geodetic monitoring over short baselines. J. Surv. Eng. 2016, 142, 04015016. [Google Scholar] [CrossRef]
  12. Biagi, L.; Grec, F.; Negretti, M. Low-cost GNSS receivers for local monitoring: Experimental simulation, and analysis of displacements. Sensors 2016, 16, 2140. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Poluzzi, L.; Tavasci, L.; Corsini, F.; Barbarella, M.; Gandolfi, S. Low-cost GNSS sensors for monitoring applications. Appl. Geomat. 2019, 12, 35–44. [Google Scholar] [CrossRef]
  14. Cina, A.; Piras, M. Performance of low-cost GNSS receiver for landslides monitoring: Test and results. Geomat. Nat. Hazards Risk 2015, 6, 497–514. [Google Scholar] [CrossRef]
  15. Glabsch, J.; Heunecke, O.; Schuhbäck, S. Monitoring the Hornbergl landslide using a recently developed low cost GNSS sensor network. J. Appl. Geod. 2009, 3. [Google Scholar] [CrossRef]
  16. Singer, J.; Schuhbäck, S.; Wasmeier, P.; Thuro, K.; Heunecke, O.; Wunderlich, T.; Glabsch, J.; Festl, J. Monitoring the Aggenalm landslide using economic deformation measurement techniques. Austrian J. Earth Sci. 2009, 102, 20–34. [Google Scholar]
  17. Bellone, T.; Dabove, P.; Manzino, A.M.; Taglioretti, C. Real-time monitoring for fast deformations using GNSS low-cost receivers. Geomat. Nat. Hazards Risk 2014, 7, 458–470. [Google Scholar] [CrossRef]
  18. Garrido-Carretero, M.S.; de Lacy-Pérez de los Cobos, M.C.; Borque-Arancón, M.J.; Ruiz-Armenteros, A.M.; Moreno-Guerrero, R.; Gil-Cruz, A.J. Low-cost GNSS receiver in RTK positioning under the standard ISO-17123-8: A feasible option in geomatics. Measurement 2019, 137, 168–178. [Google Scholar] [CrossRef]
  19. Semler, Q.; Mangin, L.; Moussaoui, A.; Semin, E. Development of a low-cost centimetric GNSS solution for android apllications. In Proceedings of the ISPRS—International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Strasbourg, France, 2–3 December 2019; Volume XLII-2/W17, pp. 309–314. [Google Scholar]
  20. Krietemeyer, A.; van der Marel, H.; van de Giesen, N.; ten Veldhuis, M.-C. High quality zenith tropospheric delay estimation using a low-cost dual-frequency receiver and relative antenna calibration. Remote Sens. 2020, 12, 1393. [Google Scholar] [CrossRef]
  21. U-Blox ZED-F9P. Available online: https://www.u-blox.com/sites/default/files/ZED-F9P_DataSheet_%28UBX-17051259%29.pdf (accessed on 13 February 2020).
  22. U-Blox U-Center. Available online: https://www.u-blox.com/en/product/u-center (accessed on 15 March 2020).
  23. Everett, T. Building a Simple U-Blox F9P Data Logger with a Sparkfun OpenLog Board. Available online: https://rtklibexplorer.wordpress.com/2019/10/25/building-a-simple-u-blox-f9p-data-logger-with-a-sparkfun-openlog-board/ (accessed on 15 March 2020).
  24. Sparkfun OpenLog DEV-13712. Available online: https://learn.sparkfun.com/tutorials/openlog-hookup-guide/all (accessed on 16 February 2020).
  25. Takasu, T. RTKLIB: An Open Source Program Package for GNSS Positioning. Available online: http://www.rtklib.com/ (accessed on 17 February 2020).
  26. Everett, T. RTKLIB Demo5_b33b. Available online: https://rtkexplorer.com/downloads/rtklib-code/ (accessed on 17 February 2020).
  27. U-Blox GNSS Antennas. Available online: https://www.u-blox.com/sites/default/files/products/documents/GNSS-Antennas_AppNote_%28UBX-15030289%29.pdf (accessed on 20 February 2020).
  28. Caspary, W.F. Concepts of Network and Deformation Analysis, 2nd ed.; Rüeger, J.M., Ed.; Monograph; School of Surveying: Kensington, Australia, 1988; ISBN 978-0-85839-044-7. [Google Scholar]
  29. Senthamarai, K.; Kuppusamy, M.; Arumugam, S. Labeling methods for identifying outliers. Int. J. Stat. Syst. 2015, 10, 231–238. [Google Scholar]
  30. Kremelberg, D. Practical Statistics: A Quick and Easy Guide to IBM® SPSS® Statistics, STATA, and Other Statistical Software; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2011; ISBN 978-1-4129-7494-3. [Google Scholar]
  31. Günter, J.; Heunecke, O.; Pink, S.; Schuhbäck, S. Developments towards a low-cost GNSS based sensor network for the monitoring of landslides. In Proceedings of the 13th FIG International Symposium on Deformation Measurements and Analysis, Lisbon, Portugal, 12–15 May 2008. [Google Scholar]
  32. Kuang, S. Geodetic Network Analysis and Optimal Design:Concepts and Applications; Ann Arbor Press: Chelsea, MI, USA, 1996; ISBN 1-57504-044-1. [Google Scholar]
  33. Savšek, S. An alternative approach to testing displacements in a geodetic network. Geod. Vestn. 2017, 61, 387–411. [Google Scholar] [CrossRef]
  34. Koch, K.-R. Parameter Estimation and Hypothesis Testing in Linear Models; Springer: Berlin/Heidelberg, Germany, 1999; ISBN 978-3-642-08461-4. [Google Scholar]
  35. Mikhail, E.M.; Gracie, G. Analysis and Adjustment of Survey Measurements; Van Nostrand Reinhold: New York, NY, USA, 1981; ISBN 978-0-442-25369-1. [Google Scholar]
Figure 1. SimpleRTK2B boards and other used equipment: (a) SimpleRTK2B boards connected to ANN-MB-00 antennae and power bank for power supply; (b) Connection of SimpleRTK2B board with OpenLog DEV-13955.
Figure 1. SimpleRTK2B boards and other used equipment: (a) SimpleRTK2B boards connected to ANN-MB-00 antennae and power bank for power supply; (b) Connection of SimpleRTK2B board with OpenLog DEV-13955.
Sensors 20 04375 g001
Figure 2. Faculty of Civil and Geodetic Engineering building.
Figure 2. Faculty of Civil and Geodetic Engineering building.
Sensors 20 04375 g002
Figure 3. GNSS receivers: (a) Reference station Leica GS 15 in pillar FGG2; (b) Rover ZED-F9P in pillar FGG1.
Figure 3. GNSS receivers: (a) Reference station Leica GS 15 in pillar FGG2; (b) Rover ZED-F9P in pillar FGG1.
Sensors 20 04375 g003
Figure 4. Specially constructed device for control movements and ground plane.
Figure 4. Specially constructed device for control movements and ground plane.
Sensors 20 04375 g004
Figure 5. Displacement detection.
Figure 5. Displacement detection.
Sensors 20 04375 g005
Figure 6. Baseline residuals for all coordinate components and both baselines: (a) Y component, G-baseline (b) Y component, L-baseline (c) X component, G-baseline (d) X component, L-baseline (e) height, G-baseline (f) height, L-baseline.
Figure 6. Baseline residuals for all coordinate components and both baselines: (a) Y component, G-baseline (b) Y component, L-baseline (c) X component, G-baseline (d) X component, L-baseline (e) height, G-baseline (f) height, L-baseline.
Sensors 20 04375 g006aSensors 20 04375 g006b
Figure 7. 1D, 2D and 3D differences between true and estimated displacement of point FGG1: (a) 1D, G-baseline; (b) 1D, L-baseline; (c) 2D, G-baseline; (d) 2D, L-baseline; (e) 3D, G-baseline; (f) 3D, L-baseline.
Figure 7. 1D, 2D and 3D differences between true and estimated displacement of point FGG1: (a) 1D, G-baseline; (b) 1D, L-baseline; (c) 2D, G-baseline; (d) 2D, L-baseline; (e) 3D, G-baseline; (f) 3D, L-baseline.
Sensors 20 04375 g007
Table 1. Used RTKLIB parameters for data processing.
Table 1. Used RTKLIB parameters for data processing.
ParametersRTKLIB
Elevation Angle10°
ObservationsL1, L2
Session Length1 h, 30 min
ConstellationsGPS, GLONASS, Galileo
TroposphereSaastamoinen
EphemerisBroadcast
AmbiguityFix and hold (LAMBDA)
Table 2. Elementary residual statistics for G-baseline.
Table 2. Elementary residual statistics for G-baseline.
StatisticsY (mm)X (mm)h (mm)
Min.−3.6−3.2−9.1
Max.2.84.48.2
RMSE1.52.04.2
Table 3. Elementary residual statistics for L-baseline.
Table 3. Elementary residual statistics for L-baseline.
StatisticsY (mm)X (mm)h (mm)
Min.−2.8−3.5−7.7
Max.4.14.35.2
RMSE1.62.02.9
Table 4. Residual classification for G-baseline.
Table 4. Residual classification for G-baseline.
RangeYXh
0–2 mm86%54%32%
2–4 mm14%43%29%
4–6 mm0%3%25%
6–8 mm0%0%7%
8–10 mm0%0%7%
Table 5. Residual classification for L-baseline.
Table 5. Residual classification for L-baseline.
RangeYXh
0–2 mm81%68%46%
2–4 mm16%26%36%
4–6 mm3%6%14%
6–8 mm0%0%4%
8–10 mm0%0%0%
Table 6. Differences of 1D, 2D, and 3D positions from G-baseline and L-baseline.
Table 6. Differences of 1D, 2D, and 3D positions from G-baseline and L-baseline.
Position1D2D3D
Differences [mm]10.42.610.7
Differences precision [mm]4.62.55.2
Table 7. Comparison of low-cost and geodetic GNSS antennas with ANOVA statistical test.
Table 7. Comparison of low-cost and geodetic GNSS antennas with ANOVA statistical test.
ANOVAYXh
F5.2717.61110.69
F critical 4.024.024.02
Table 8. Detection of displacement in 1D (height component).
Table 8. Detection of displacement in 1D (height component).
G-BaselineL-Baseline
Not Detected98%77%
Detected2%23%
Table 9. Detection of 2D displacements.
Table 9. Detection of 2D displacements.
G-BaselineL-Baseline
Displacement Size10 mm15 mm20 mm10 mm15 mm20 mm
Detected100%100%100%100%100%100%
Table 10. Detection of 3D displacements.
Table 10. Detection of 3D displacements.
G-BaselineL-Baseline
Displacement Size10 mm15 mm20 mm10 mm15 mm20 mm
Detected100%100%100%97%100%100%
Table 11. Mean Absolute Error (MAE) for evaluated 1D, 2D, and 3D movements.
Table 11. Mean Absolute Error (MAE) for evaluated 1D, 2D, and 3D movements.
G-BaselineL-Baseline
Dimension1D2D3D1D2D3D
MAE (mm)4.01.92.35.03.23.8

Share and Cite

MDPI and ACS Style

Hamza, V.; Stopar, B.; Ambrožič, T.; Turk, G.; Sterle, O. Testing Multi-Frequency Low-Cost GNSS Receivers for Geodetic Monitoring Purposes. Sensors 2020, 20, 4375. https://doi.org/10.3390/s20164375

AMA Style

Hamza V, Stopar B, Ambrožič T, Turk G, Sterle O. Testing Multi-Frequency Low-Cost GNSS Receivers for Geodetic Monitoring Purposes. Sensors. 2020; 20(16):4375. https://doi.org/10.3390/s20164375

Chicago/Turabian Style

Hamza, Veton, Bojan Stopar, Tomaž Ambrožič, Goran Turk, and Oskar Sterle. 2020. "Testing Multi-Frequency Low-Cost GNSS Receivers for Geodetic Monitoring Purposes" Sensors 20, no. 16: 4375. https://doi.org/10.3390/s20164375

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop