Next Article in Journal
Living Benthic Foraminifera from the Surface and Subsurface Sediment Layers Applied to the Environmental Characterization of the Brazilian Continental Slope (SW Atlantic)
Previous Article in Journal
Uncertainty and Sensitivity Analysis of Input Conditions in a Large Shallow Lake Based on the Latin Hypercube Sampling and Morris Methods
Article

Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series

1
Department of Computer Engineering, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand
2
Department of Mathematics, Faculty of Science, Kasetsart University, Bangkok 10900, Thailand
3
Excellent Center for Big Data Analytics on Food and Agriculture, Kasetsart University, Bangkok 10900, Thailand
4
Department of Industrial Engineering, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand
5
Hydro-Informatics Institute, Bangkok 10900, Thailand
*
Author to whom correspondence should be addressed.
Academic Editor: Anis Younes
Water 2021, 13(13), 1862; https://doi.org/10.3390/w13131862
Received: 3 June 2021 / Revised: 25 June 2021 / Accepted: 30 June 2021 / Published: 3 July 2021
(This article belongs to the Section Hydrology)
Water level data obtained from telemetry stations typically contains large number of outliers. Anomaly detection and a data imputation are necessary steps in a data monitoring system. Anomaly data can be detected if its values lie outside of a normal pattern distribution. We developed a median-based statistical outlier detection approach using a sliding window technique. In order to fill anomalies, various interpolation techniques were considered. Our proposed framework exhibited promising results after evaluating with F1-score and root mean square error (RMSE) based on our artificially induced data points. The present system can also be easily applied to various patterns of hydrological time series with diverse choices of internal methods and fine-tuned parameters. Specifically, the Spline interpolation method yielded a superior performance on non-cyclical data while the long short-term memory (LSTM) outperformed other interpolation methods on a distinct tidal data pattern. View Full-Text
Keywords: water management; anomaly detection; data imputation; time series; sliding window; median absolute deviation; LSTM water management; anomaly detection; data imputation; time series; sliding window; median absolute deviation; LSTM
Show Figures

Figure 1

MDPI and ACS Style

Kulanuwat, L.; Chantrapornchai, C.; Maleewong, M.; Wongchaisuwat, P.; Wimala, S.; Sarinnapakorn, K.; Boonya-aroonnet, S. Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series. Water 2021, 13, 1862. https://doi.org/10.3390/w13131862

AMA Style

Kulanuwat L, Chantrapornchai C, Maleewong M, Wongchaisuwat P, Wimala S, Sarinnapakorn K, Boonya-aroonnet S. Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series. Water. 2021; 13(13):1862. https://doi.org/10.3390/w13131862

Chicago/Turabian Style

Kulanuwat, Lattawit, Chantana Chantrapornchai, Montri Maleewong, Papis Wongchaisuwat, Supaluk Wimala, Kanoksri Sarinnapakorn, and Surajate Boonya-aroonnet. 2021. "Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series" Water 13, no. 13: 1862. https://doi.org/10.3390/w13131862

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop