Spatial and Time Warping for Gauge Adjustment of Rainfall Estimates
Abstract
:1. Introduction
2. Methodology
2.1. Spatial Warping
2.1.1. Definitions
- , i.e., the mapping has to be as small as possible;
- , i.e., the mapping has to be as smooth as possible;
- , i.e., the mapping is not shrinking or expanding the domain.
2.1.2. Automatic Registration
Irregularly Spaced Observations
Time Dimension
2.1.3. Workflow
- The light precipitation is removed from the fields. Practically, all rainfall below 1 mm/h was set to zero. The automatic registration needs the fields u and v to be similar. Low precipitation has a higher spatial variability and is more difficult to estimate. Thus, low precipitation in the two fields can be very different and so is less suitable for the automatic registration. A minimum threshold of 1 mm/h was chosen as a reasonable value, which in the analysis gave good results;
- A padding area is added around the domain. This area is filled with zero precipitation. It is used to avoid unrealistic distortion in the mapping near the boundary. These distortions are due to precipitation near the border and the constraint ensuring that no grid nodes can leave the domain.
2.2. Time Warping
2.2.1. Definitions
- , i.e., the mapping has to be as small as possible;
- , i.e., the mapping has to be as smooth as possible.
2.2.2. Automatic Registration
Spatial Dimension
2.2.3. Workflow
3. Case Studies
3.1. Synthetic Case
3.2. Southern Ghana Case
4. Results
4.1. Synthetic Case
4.1.1. Mappings’ Comparison
Spatial Mappings
Time Mappings
4.1.2. Validation
4.2. Southern Ghana Case
4.2.1. Mappings’ Comparison
Sensitivity of the Spatial Mappings
Sensitivity of the Time Mappings
4.2.2. Validation
Position Error
Timing Error
5. Discussion
5.1. Parameters Influencing the Warping
5.2. Computational Cost and Alternative Methods
6. Conclusions
- The continuous statistics were significantly improved after the warping either in time or in space, e.g., the correlation went from 0.2 to about 0.6 after either warping for the southern Ghana case;
- The timing error was considerably decreased by both types of warping, sometimes more by the spatial one than by the time one. In the southern Ghana case, the spatial and time warpings decreased the average timing error from 1.1 h to 0.40 h and 0.20 h, respectively. In the synthetic case, the error was reduced from 2.21 h to 0.50 h by the spatial warping, but to 0.77 h by the time warping;
- The position error was decreased significantly by the spatial warping; however, the time warping only had a limited impact on it. The average position error was reduced by about 45 km after spatial warping in the southern Ghana case.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
References
- Ball, J.E. The influence of storm temporal patterns on catchment response. J. Hydrol. 1994, 285–303. [Google Scholar] [CrossRef]
- Singh, V.P. Effect of spatial and temporal variability in rainfall and watershed characteristics on stream flow hydrograph. Hydrol. Process. 1997, 11, 1649–1669. [Google Scholar] [CrossRef]
- Máca, P.; Torfs, P. The influence of temporal rainfall distribution in the flood runoff modeling. Soil Water Res. 2009, 4, S102–S110. [Google Scholar] [CrossRef] [Green Version]
- Pfeifroth, U.; Trentmann, J.; Fink, A.H.; Ahrens, B. Evaluating Satellite-Based Diurnal Cycles of Precipitation in the African Tropics. J. Appl. Meteorol. Climatol. 2016, 55, 23–39. [Google Scholar] [CrossRef] [Green Version]
- Zagor, V.V.N. Automatic recognition of 200 words. Int. J. Man-Mach. Stud. 1970, 2, 223–234. [Google Scholar] [CrossRef]
- Sakoe, H.; Chiba, S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 1978, 26, 159–165. [Google Scholar] [CrossRef] [Green Version]
- Keogh, E.; Pazzani, M. Derivative Dynamic Time Warping. In Proceedings of the 2001 SIAM International Conference on Data Mining, Chicago, IL, USA, 5–7 April 2001; Volume 1. [Google Scholar] [CrossRef] [Green Version]
- McIntosh, J.; Yuan, M. Assessing Similarity of Geographic Processes and Events. Trans. GIS 2005, 9, 223–245. [Google Scholar] [CrossRef]
- Lu, S.; ten Veldhuis, M.C.; van de Giesen, N.; Heemink, A.; Verlaan, M. Precipitation Regime Classification Based on Cloud-Top Temperature Time Series for Spatially-Varied Parameterization of Precipitation Models. Remote Sens. 2020, 12, 289. [Google Scholar] [CrossRef] [Green Version]
- Mantas, V.M.; Liu, Z.; Caro, C.; Pereira, A.J.S.C. Validation of TRMM multi-satellite precipitation analysis (TMPA) products in the Peruvian Andes. Atmos. Res. 2015, 163, 132–145. [Google Scholar] [CrossRef]
- Dilmi, M.D.; Barthès, L.; Mallet, C.; Chazottes, A. Iterative multiscale dynamic time warping (IMs-DTW): A tool for rainfall time series comparison. Int. J. Data Sci. Anal. 2020, 10, 65–79. [Google Scholar] [CrossRef]
- Dilmi, M.D.; Barthès, L.; Mallet, C.; Chazottes, A. Study of the impact of climate change on precipitation in Paris area using method based on iterative multiscale dynamic time warping (IMS-DTW). arXiv 2019, arXiv:stat.AP/1910.10809. [Google Scholar]
- Gilleland, E.; Ahijevych, D.; Brown, B.G.; Casati, B.; Ebert, E.E. Intercomparison of Spatial Forecast Verification Methods. Weather Forecast. 2009, 24, 1416–1430. [Google Scholar] [CrossRef]
- Ahijevych, D.; Gilleland, E.; Brown, B.G.; Ebert, E.E. Application of Spatial Verification Methods to Idealized and NWP-Gridded Precipitation Forecasts. Weather Forecast. 2009, 24, 1485–1497. [Google Scholar] [CrossRef] [Green Version]
- Hoffman, R.N.; Grassotti, C. A Technique for Assimilating SSM/I Observations of Marine Atmospheric Storms: Tests with ECMWF Analyses. J. Appl. Meteorol. 1996, 35, 1177–1188. [Google Scholar] [CrossRef] [Green Version]
- Nehrkorn, T.; Woods, B.K.; Hoffman, R.N.; Auligné, T. Correcting for Position Errors in Variational Data Assimilation. Mon. Weather Rev. 2015, 143, 1368–1381. [Google Scholar] [CrossRef] [Green Version]
- Aonashi, K.; Eito, H. Displaced Ensemble Variational Assimilation Method to Incorporate Microwave Imager Brightness Temperatures into a Cloud-resolving Model. J. Meteorol. Soc. Jpn. Ser. II 2011, 89, 175–194. [Google Scholar] [CrossRef] [Green Version]
- Brewster, K.A. Phase-Correcting Data Assimilation and Application to Storm-Scale Numerical Weather Prediction. Part I: Method Description and Simulation Testing. Mon. Weather Rev. 2003, 131, 480–492. [Google Scholar] [CrossRef] [Green Version]
- Lawson, W.G.; Hansen, J.A. Alignment Error Models and Ensemble-Based Data Assimilation. Mon. Weather Rev. 2005, 133, 1687–1709. [Google Scholar] [CrossRef]
- Ravela, S.; Emanuel, K.; McLaughlin, D. Data assimilation by field alignment. Phys. D Nonlinear Phenom. 2007, 230, 127–145, Data Assim. [Google Scholar] [CrossRef]
- Grassotti, C.; Iskenderian, H.; Hoffman, R.N. Calibration and Alignment. J. Appl. Meteorol. 1999, 38, 677–695. [Google Scholar] [CrossRef]
- Alexander, G.D.; Weinman, J.A.; Schols, J.L. The Use of Digital Warping of Microwave Integrated Water Vapor Imagery to Improve Forecasts of Marine Extratropical Cyclones. Mon. Weather Rev. 1998, 126, 1469–1496. [Google Scholar] [CrossRef]
- Beezley, J.D.; Mandel, J. Morphing ensemble Kalman filters. Tellus A 2008, 60, 131–140. [Google Scholar] [CrossRef] [Green Version]
- Mandel, J.; Beezley, J.D.; Eben, K.; Jurus, P.; Kondratenko, V.Y.; Resler, J. Data Assimilation by Morphing Fast Fourier Transform Ensemble Kalman Filter for Precipitation Forecasts Using Radar Images; UCD/CCM Report 289; Center for Computational Mathematics, University of Colorado at Denver: Denver, CO, USA, 2010. [Google Scholar]
- Le Coz, C.; Heemink, A.; Verlaan, M.; ten Veldhuis, M.C.; van de Giesen, N. Correcting Position Error in Precipitation Data Using Image Morphing. Remote Sens. 2019, 11, 2557. [Google Scholar] [CrossRef] [Green Version]
- Huffman, G.J.; Bolvin, D.T.; Braithwaite, D.; Hsu, K.; Joyce, R.; Kidd, C.; Nelkin, E.J.; Sorooshian, S.; Tan, J.; Xie, P. NASA Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals for GPM (IMERG). In Algorithm Theoretical Basis Document Version 6; NASA GSFC: Greenbelt, MD, USA, 2019. Available online: https://gpm.nasa.gov/sites/default/files/document_files/IMERG_ATBD_V06.pdf (accessed on 14 November 2021).
- van de Giesen, N.; Hut, R.; Selker, J. The Trans-African Hydro-Meteorological Observatory (TAHMO). Wiley Interdiscip. Rev. Water 2014, 1, 341–348. [Google Scholar] [CrossRef] [Green Version]
- Dezfuli, A.K.; Ichoku, C.M.; Huffman, G.J.; Mohr, K.I.; Selker, J.S.; van de Giesen, N.; Hochreutener, R.; Annor, F.O. Validation of IMERG Precipitation in Africa. J. Hydrometeorol. 2017, 18, 2817–2825. [Google Scholar] [CrossRef] [PubMed]
- Dezfuli, A.K.; Ichoku, C.M.; Mohr, K.I.; Huffman, G.J. Precipitation Characteristics in West and East Africa from Satellite and in Situ Observations. J. Hydrometeorol. 2017, 18, 1799–1805. [Google Scholar] [CrossRef]
- Hastie, T.; Tibshirani, R.; Friedman, J. Model Assessment and Selection. In The Elements of Statistical Learning: Data Mining, Inference, and Prediction; Springer: New York, NY, USA, 2009; pp. 219–259. [Google Scholar] [CrossRef]
- Le Coz, C. Setting Africa’s Rainfall Straight: A Warping Approach to Position and Timing Errors in Rainfall Estimates. Ph.D. Thesis, Delft University of Technology, Delft, The Netherlands, 2021. [Google Scholar] [CrossRef]
Before | After | ||
---|---|---|---|
Spatial Warping | Time Warping | ||
RMSE (mm/h) | 5.62 | 2.65 | 2.76 |
MAE (mm/h) | 1.65 | 0.64 | 0.73 |
Correlation | 0.12 | 0.79 | 0.76 |
Threshold (peak) | Sample Number | Before | After | |
---|---|---|---|---|
Spatial Warping | Time Warping | |||
>1 mm/h | n = 10 | 98.54 | 15.78 | 73.11 |
>10 mm/h | n = 7 | 90.76 | 7.37 | 63.54 |
>20 mm/h | n = 5 | 89.54 | 8.10 | 60.80 |
Threshold (peak) | Sample Number | Before | After | |
---|---|---|---|---|
Spatial Warping | Time Warping | |||
>1 mm/h | n = 1128 | 2.21 | 0.50 | 0.77 |
>10 mm/h | n = 565 | 2.07 | 0.22 | 0.67 |
>20 mm/h | n = 315 | 2.07 | 0.17 | 0.59 |
Before | Spatial Warping | Time Warping | |||
---|---|---|---|---|---|
All | LOOV | All | LOOV | ||
RMSE (mm/h) | 1.89 | 1.39 | 1.49 | 1.51 | 1.51 |
MAE (mm/h) | 0.20 | 0.13 | 0.14 | 0.12 | 0.13 |
Correlation | 0.18 | 0.70 | 0.62 | 0.66 | 0.66 |
Threshold (peak) | Sample Number | Before | Spatial Warping | Time Warping |
---|---|---|---|---|
>1 mm/h | n = 9 | 124.53 | 76.90 | 114.90 |
>5 mm/h | n = 4 | 82.45 | 21.23 | 65.62 |
>10 mm/h | n = 2 | 68.32 | 22.20 | 74.58 |
Threshold (peak) | Sample Number | Before | Spatial Warping | Time Warping | ||
---|---|---|---|---|---|---|
All | LOOV | All | LOOV | |||
>1 mm/h | n = 10 | 1.10 | 0.40 | 0.40 | 0.10 | 0.20 |
>5 mm/h | n = 7 | 1.00 | 0.29 | 0.14 | 0.00 | 0.14 |
>10 mm/h | n = 5 | 1.20 | 0.20 | 0.20 | 0.00 | 0.00 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Le Coz, C.; Heemink, A.; Verlaan, M.; van de Giesen, N. Spatial and Time Warping for Gauge Adjustment of Rainfall Estimates. Atmosphere 2021, 12, 1510. https://doi.org/10.3390/atmos12111510
Le Coz C, Heemink A, Verlaan M, van de Giesen N. Spatial and Time Warping for Gauge Adjustment of Rainfall Estimates. Atmosphere. 2021; 12(11):1510. https://doi.org/10.3390/atmos12111510
Chicago/Turabian StyleLe Coz, Camille, Arnold Heemink, Martin Verlaan, and Nick van de Giesen. 2021. "Spatial and Time Warping for Gauge Adjustment of Rainfall Estimates" Atmosphere 12, no. 11: 1510. https://doi.org/10.3390/atmos12111510
APA StyleLe Coz, C., Heemink, A., Verlaan, M., & van de Giesen, N. (2021). Spatial and Time Warping for Gauge Adjustment of Rainfall Estimates. Atmosphere, 12(11), 1510. https://doi.org/10.3390/atmos12111510