A platform for research: civil engineering, architecture and urbanism
Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series
Water level data obtained from telemetry stations typically contains large number of outliers. Anomaly detection and a data imputation are necessary steps in a data monitoring system. Anomaly data can be detected if its values lie outside of a normal pattern distribution. We developed a median-based statistical outlier detection approach using a sliding window technique. In order to fill anomalies, various interpolation techniques were considered. Our proposed framework exhibited promising results after evaluating with F1-score and root mean square error (RMSE) based on our artificially induced data points. The present system can also be easily applied to various patterns of hydrological time series with diverse choices of internal methods and fine-tuned parameters. Specifically, the Spline interpolation method yielded a superior performance on non-cyclical data while the long short-term memory (LSTM) outperformed other interpolation methods on a distinct tidal data pattern.
Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series
Water level data obtained from telemetry stations typically contains large number of outliers. Anomaly detection and a data imputation are necessary steps in a data monitoring system. Anomaly data can be detected if its values lie outside of a normal pattern distribution. We developed a median-based statistical outlier detection approach using a sliding window technique. In order to fill anomalies, various interpolation techniques were considered. Our proposed framework exhibited promising results after evaluating with F1-score and root mean square error (RMSE) based on our artificially induced data points. The present system can also be easily applied to various patterns of hydrological time series with diverse choices of internal methods and fine-tuned parameters. Specifically, the Spline interpolation method yielded a superior performance on non-cyclical data while the long short-term memory (LSTM) outperformed other interpolation methods on a distinct tidal data pattern.
Anomaly Detection Using a Sliding Window Technique and Data Imputation with Machine Learning for Hydrological Time Series
Lattawit Kulanuwat (author) / Chantana Chantrapornchai (author) / Montri Maleewong (author) / Papis Wongchaisuwat (author) / Supaluk Wimala (author) / Kanoksri Sarinnapakorn (author) / Surajate Boonya-aroonnet (author)
2021
Article (Journal)
Electronic Resource
Unknown
Metadata by DOAJ is licensed under CC BY-SA 1.0
Imputation of missing data in time series for air pollutants
Elsevier | 2015
|Imputation of missing data in time series for air pollutants
Elsevier | 2014
|Hydrological time series prediction by extreme learning machine and sparrow search algorithm
DOAJ | 2022
|