# Modeling of Residual GNSS Station Motions through Meteorological Data in a Machine Learning Approach

^{*}

## Abstract

**:**

## 1. Introduction

## 2. Data and Pre-Processing

#### 2.1. GNSS Height Residuals

#### 2.2. Environmental Surface Loadings

#### 2.3. Meteorological Data

#### 2.4. Reduction of GNSS Residuals by Environmental Loadings

## 3. Methodology

#### 3.1. Temporal Convolutional Network

- (1)
- the network can take an input sequence of any length and return the same length as output by using a 1D fully convolutional architecture, and
- (2)

#### 3.2. Implementation Details

_{MOD}. These are subtracted from the corresponding GNSS residuals from the test dataset, which results in the reduced GNSS time series GNSS

_{RED}.

## 4. Results and Discussion

#### 4.1. TCN Modeling and GNSS Reduction and Comparison to Physical Loading Model Reduction

#### 4.2. TCN Modeling Based on GNSS Residuals Reduced by Loading Models

## 5. Conclusions and Outlook

## Author Contributions

## Funding

## Institutional Review Board Statement

## Informed Consent Statement

## Data Availability Statement

## Acknowledgments

## Conflicts of Interest

## References

- van Dam, T.M.; Blewitt, G.; Heflin, M.B. Atmospheric pressure loading effects on Global Positioning System coordinate determinations. J. Geophys. Res. Space Phys.
**1994**, 99, 23939–23950. [Google Scholar] [CrossRef] - van Dam, T.M.; Wahr, J.; Chao, Y.; Leuliette, E. Predictions of crustal deformation and of geoid and sea-level variability caused by oceanic and atmospheric loading. Geophys. J. Int.
**1997**, 129, 507–517. [Google Scholar] [CrossRef] - Dam, T.V.; Wahr, J.; Milly, P.C.D.; Shmakin, A.B.; Blewitt, G.; Lavallée, D.; Larson, K.M. Crustal displacements due to continental water loading. Geophys. Res. Lett.
**2001**, 28, 651–654. [Google Scholar] [CrossRef][Green Version] - Gegout, P.; Boy, J.P.; Hinderer, J.; Ferhat, G. Modeling and Observation of Loading Contribution to Time-Variable GPS Sites Positions. In Gravity, Geoid and Earth Observation; Mertikas, S.P., Ed.; Springer: Berlin/Heidelberg, Germany, 2010; pp. 651–659. [Google Scholar] [CrossRef]
- Bian, Y. Comparisons of GRACE and GLDAS derived hydrological loading and the impacts on the GPS time series in Europe. Acta Geodyn. Geomater.
**2020**, 17, 297–310. [Google Scholar] [CrossRef] - Jiang, W.; Li, Z.; van Dam, T.; Ding, W. Comparative analysis of different environmental loading methods and their impacts on the GPS height time series. J. Geod.
**2013**, 87, 687–703. [Google Scholar] [CrossRef] - Wu, S.; Nie, G.; Meng, X.; Liu, J.; He, Y.; Xue, C.; Li, H. Comparative Analysis of the Effect of the Loading Series from GFZ and EOST on Long-Term GPS Height Time Series. Remote Sens.
**2020**, 12, 2822. [Google Scholar] [CrossRef] - Li, C.; Huang, S.; Chen, Q.; Dam, T.V.; Fok, H.S.; Zhao, Q.; Wu, W.; Wang, X. Quantitative Evaluation of Environmental Loading Induced Displacement Products for Correcting GNSS Time Series in CMONOC. Remote Sens.
**2020**, 12, 594. [Google Scholar] [CrossRef][Green Version] - Deng, L.; Chen, H.; Ma, A.; Chen, Q. Non-Tidal Mass Variations in the IGS Second Reprocessing Campaign: Interpretations and Noise Analysis from GRACE and Geophysical Models. Remote Sens.
**2020**, 12, 2477. [Google Scholar] [CrossRef] - Karegar, M.A.; Dixon, T.H.; Kusche, J.; Chambers, D.P. A New Hybrid Method for Estimating Hydrologically Induced Vertical Deformation From GRACE and a Hydrological Model: An Example From Central North America. J. Adv. Model. Earth Syst.
**2018**, 10, 1196–1217. [Google Scholar] [CrossRef] - Klos, A.; Karegar, M.A.; Kusche, J.; Springer, A. Quantifying Noise in Daily GPS Height Time Series: Harmonic Function Versus GRACE-Assimilating Modeling Approaches. IEEE Geosci. Remote Sens. Lett.
**2021**, 18, 627–631. [Google Scholar] [CrossRef] - Mémin, A.; Boy, J.P.; Santamaría-Gómez, A. Correcting GPS measurements for non-tidal loading. GPS Solut.
**2020**, 24, 45. [Google Scholar] [CrossRef] - Siemuri, A.; Kuusniemi, H.; Elmusrati, M.S.; Välisuo, P.; Shamsuzzoha, A. Machine Learning Utilization in GNSS—Use Cases, Challenges and Future Applications. In Proceedings of the 2021 International Conference on Localization and GNSS (ICL-GNSS), Tampere, Finland, 1–3 June 2021; pp. 1–6. [Google Scholar] [CrossRef]
- Benevides, P.; Catalao, J.; Miranda, P.M.A. On the inclusion of GPS precipitable water vapour in the nowcasting of rainfall. Nat. Hazards Earth Syst. Sci.
**2015**, 15, 2605–2616. [Google Scholar] [CrossRef][Green Version] - Benevides, P.; Catalão, J.; Nico, G.; Miranda, P.M.A. Evaluation of rainfall forecasts combining GNSS precipitable water vapor with ground and remote sensing meteorological variables in a neural network approach. In Remote Sensing of Clouds and the Atmosphere XXIII; International Society for Optics and Photonics: Berlin, Germany, 2018; Volume 10786, p. 1078607. [Google Scholar] [CrossRef]
- Li, H.; Wang, X.; Zhang, K.; Wu, S.; Xu, Y.; Liu, Y.; Qiu, C.; Zhang, J.; Fu, E.; Li, L. A neural network-based approach for the detection of heavy precipitation using GNSS observations and surface meteorological data. J. Atmosp. Sol.-Terr. Phys.
**2021**, 225, 105763. [Google Scholar] [CrossRef] - Łoś, M.; Smolak, K.; Guerova, G.; Rohm, W. GNSS-Based Machine Learning Storm Nowcasting. Remote Sens.
**2020**, 12, 2536. [Google Scholar] [CrossRef] - Selbesoglu, M.O. Prediction of tropospheric wet delay by an artificial neural network model based on meteorological and GNSS data. Eng. Sci. Technol. Int. J.
**2020**, 23, 967–972. [Google Scholar] [CrossRef] - Li, L.; Xu, Y.; Yan, L.; Wang, S.; Liu, G.; Liu, F. A Regional NWP Tropospheric Delay Inversion Method Based on a General Regression Neural Network Model. Sensors
**2020**, 20, 3167. [Google Scholar] [CrossRef] - Mohammed, J. Artificial neural network for predicting global sub-daily tropospheric wet delay. J. Atmosp. Sol.-Terr. Phys.
**2021**, 217, 105612. [Google Scholar] [CrossRef] - Miotti, L.; Shehaj, E.; Geiger, A.; D’Aronco, S.; Wegner, J.D.; Moeller, G.; Rothacher, M. Tropospheric delays derived from ground meteorological parameters: Comparison between machine learning and empirical model approaches. In Proceedings of the 2020 European Navigation Conference (ENC), Dresden, Germany, 23–24 November 2020; pp. 1–10. [Google Scholar] [CrossRef]
- Mohammednour, A.B.; Özdemir, A.T. GNSS positioning accuracy improvement based on surface meteorological parameters using artificial neural networks. Int. J. Commun. Syst.
**2020**, 33, e4373. [Google Scholar] [CrossRef] - Blewitt, G.; Hammond, W.C.; Kreemer, C. Harnessing the GPS Data Explosion for Interdisciplinary Science. Eos
**2018**, 99, 485. [Google Scholar] [CrossRef] - Bos, M.S.; Fernandes, R.M.S.; Williams, S.D.P.; Bastos, L. Fast error analysis of continuous GNSS observations with missing data. J. Geod.
**2013**, 87, 351–360. [Google Scholar] [CrossRef][Green Version] - Dill, R.; Dobslaw, H. Numerical simulations of global-scale high-resolution hydrological crustal deformations. J. Geophys. Res. Solid Earth
**2013**, 118, 5008–5017. [Google Scholar] [CrossRef] - Ruttner, P. Analysis and Prediction of Long Term GNSS Height Time Series and Environmental Loading Effects; ETH Zurich: Zurich, Switzerland, 2021. [Google Scholar] [CrossRef]
- Klein Tank, A.M.G.; Wijngaard, J.B.; Können, G.P.; Böhm, R.; Demarée, G.; Gocheva, A.; Mileta, M.; Pashiardis, S.; Hejkrlik, L.; Kern-Hansen, C.; et al. Daily dataset of 20th-century surface air temperature and precipitation series for the European Climate Assessment. Int. J. Climatol.
**2002**, 22, 1441–1453. [Google Scholar] [CrossRef] - Springer, A.; Karegar, M.A.; Kusche, J.; Keune, J.; Kurtz, W.; Kollet, S. Evidence of daily hydrological loading in GPS time series over Europe. J. Geod.
**2019**, 93, 2145–2153. [Google Scholar] [CrossRef] - Bai, S.; Kolter, J.Z.; Koltun, V. An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv
**2018**, arXiv:1803.01271. [Google Scholar] - Lea, C.; Flynn, M.D.; Vidal, R.; Reiter, A.; Hager, G.D. Temporal Convolutional Networks for Action Segmentation and Detection. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 1003–1012. [Google Scholar] [CrossRef][Green Version]
- Yan, J.; Mu, L.; Wang, L.; Ranjan, R.; Zomaya, A.Y. Temporal Convolutional Networks for the Advance Prediction of ENSO. Sci. Rep.
**2020**, 10, 8055. [Google Scholar] [CrossRef] [PubMed] - Hewage, P.; Behera, A.; Trovati, M.; Pereira, E.; Ghahremani, M.; Palmieri, F.; Liu, Y. Temporal convolutional neural (TCN) network for an effective weather forecasting using time-series data from the local weather station. Soft Comput.
**2020**, 24, 16453–16482. [Google Scholar] [CrossRef][Green Version] - Li, R.; Chu, Z.; Jin, W.; Wang, Y.; Hu, X. Temporal Convolutional Network Based Regression Approach for Estimation of Remaining Useful Life. In Proceedings of the 2021 IEEE International Conference on Prognostics and Health Management (ICPHM), Detroit, MI, USA, 7–9 June 2021; pp. 1–10. [Google Scholar] [CrossRef]
- Xue, L.; Fu, Y.; Martens, H.R. Seasonal hydrological loading in the Great Lakes region detected by GNSS: A comparison with hydrological models. Geophys. J. Int.
**2021**, 226, 1174–1186. [Google Scholar] [CrossRef] - Hsu, Y.J.; Fu, Y.; Bürgmann, R.; Hsu, S.Y.; Lin, C.C.; Tang, C.H.; Wu, Y.M. Assessing seasonal and interannual water storage variations in Taiwan using geodetic and hydrological data|Elsevier Enhanced Reader. Earth Planet. Sci. Lett.
**2020**, 550, 116532. [Google Scholar] [CrossRef] - Materna, K.; Feng, L.; Lindsey, E.O.; Hill, E.M.; Ahsan, A.; Alam, A.K.M.K.; Oo, K.M.; Than, O.; Aung, T.; Khaing, S.N.; et al. GNSS characterization of hydrological loading in South and Southeast Asia. Geophys. J. Int.
**2021**, 224, 1742–1752. [Google Scholar] [CrossRef] - Michel, A.; Santamaría-Gómez, A.; Boy, J.P.; Perosanz, F.; Loyer, S. Analysis of GNSS Displacements in Europe and Their Comparison with Hydrological Loading Models. Remote Sens.
**2021**, 13, 4523. [Google Scholar] [CrossRef]

**Figure 1.**Distribution of selected GNSS stations over Europe. The size of the circles indicates the available time series length in years.

**Figure 2.**Environmental surface loadings at station MAR3. For visualization purposes, HYDL is shifted by +30 mm, NTOL by −15 mm, and the SUM (HYDL + NTAL + NTOL) by −30 mm.

**Figure 3.**Time series of the meteorological parameters at the example station MAR3. TG = Temperature, RR = Precipitation, PP = Sea level pressure, HU = Humidity, QQ = Radiation.

**Figure 4.**(

**Left**) GNSS and meteorological station locations. (

**Right**) GNSS station locations, colored by the distance to the corresponding meteorological station.

**Figure 5.**Workflow of GNSS data processing. The main input and output datasets are colored in green, processing steps are marked in orange, and the intermediate products are in colored in red.

**Figure 7.**RMS reduction of GNSS height residuals after subtracting the sum of all environmental surface loadings.

**Figure 8.**Example of a dilated causal convolution, with a filter size $k=3$ and dilation factors $d=1,2,4$.

**Figure 10.**Flowchart of TCN training pipeline. The main input and output datasets are colored in green, processing steps are marked in orange, and the intermediate products are in colored in red and blue.

**Figure 11.**Example of TCN-modeled residuals at the example station MAR3. In blue are the GNSS residuals, and in orange are the TCN-modeled time series.

**Figure 12.**RMS reduction of GNSS height residuals after subtracting a TCN-modeled signal with meteorological parameters as input features.

**Figure 13.**Difference in RMS reductions between the reduction rates of GNSS residuals when using the physical models from GFZ and a TCN-modeled signal from meteorological parameters.

**Figure 14.**Example of resulting modeled residuals at the example station MAR3. In blue are the by environmental loadings reduced residuals, and in orange are the TCN-modeled time series.

**Figure 15.**GNSS residuals at the different reduction stages. In blue are the original GNSS residuals, in orange are the time series after subtracting the environmental loading displacements, and the green residuals result after subtracting the TCN-modeled time series.

**Figure 16.**RMS reduction of reduced GNSS height residuals after subtracting a TCN-modeled signal with meteorological parameters as input features.

**Figure 17.**Total RMS reduction of GNSS height residuals after subtracting environmental surface loadings and the TCN-modeled signal.

Parameter | Value(s) |
---|---|

batch size B | 2 |

number of features F | 8 |

sequence length (epochs) T | 7 |

filter size k | 8 |

dilations d | 1, 2, 4, 8, 16, 32, 64, 128, 256 |

number of filters | 24 |

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |

© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

## Share and Cite

**MDPI and ACS Style**

Ruttner, P.; Hohensinn, R.; D’Aronco, S.; Wegner, J.D.; Soja, B.
Modeling of Residual GNSS Station Motions through Meteorological Data in a Machine Learning Approach. *Remote Sens.* **2022**, *14*, 17.
https://doi.org/10.3390/rs14010017

**AMA Style**

Ruttner P, Hohensinn R, D’Aronco S, Wegner JD, Soja B.
Modeling of Residual GNSS Station Motions through Meteorological Data in a Machine Learning Approach. *Remote Sensing*. 2022; 14(1):17.
https://doi.org/10.3390/rs14010017

**Chicago/Turabian Style**

Ruttner, Pia, Roland Hohensinn, Stefano D’Aronco, Jan Dirk Wegner, and Benedikt Soja.
2022. "Modeling of Residual GNSS Station Motions through Meteorological Data in a Machine Learning Approach" *Remote Sensing* 14, no. 1: 17.
https://doi.org/10.3390/rs14010017