A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
An automatic data process line identification method for dam safety monitoring data outlier detection
In order to discover anomalies of dam structure behaviors and evaluate the operation status timely, it is quite demanding to analyze the dam safety monitoring data that has been collected from the instruments. However, outliers in original monitoring data may affect the accuracy of dam performance assessment, which need to be detected before analyzing monitoring data. Model‐based methods have been applied in outlier detection as a kind of common method for a long time, but they generally rely heavily on model accuracy and easily lead to misjudgment of outliers once the data structure is complex. Considering the monitoring data of dam effect variables (e.g., deformation, cracking, or seepage) tend to show strong continuity, complex periodic and trending changes with the environment, valid monitoring data can reflect the variation trend by forming a data process line. Therefore, data that deviate from the process line can be detected as outliers. In this paper, an automatic process line identification method for dam safety monitoring data outlier detection is proposed. First, after drawing a scatter plot of the dam monitoring data, a binary image of the scatter plot is inputted into the computer program. Afterwards, the binary image would be processed by Gaussian blur and image binarization techniques, and then the continuous points could be identified. After constant adjustment of the vertical ordinate range and introducing Cuckoo Search (CS) algorithm, the optimal process line identification and outlier detection were finally completed. The case studies demonstrate the proposed method can enhance the efficiency of outlier detection.
An automatic data process line identification method for dam safety monitoring data outlier detection
In order to discover anomalies of dam structure behaviors and evaluate the operation status timely, it is quite demanding to analyze the dam safety monitoring data that has been collected from the instruments. However, outliers in original monitoring data may affect the accuracy of dam performance assessment, which need to be detected before analyzing monitoring data. Model‐based methods have been applied in outlier detection as a kind of common method for a long time, but they generally rely heavily on model accuracy and easily lead to misjudgment of outliers once the data structure is complex. Considering the monitoring data of dam effect variables (e.g., deformation, cracking, or seepage) tend to show strong continuity, complex periodic and trending changes with the environment, valid monitoring data can reflect the variation trend by forming a data process line. Therefore, data that deviate from the process line can be detected as outliers. In this paper, an automatic process line identification method for dam safety monitoring data outlier detection is proposed. First, after drawing a scatter plot of the dam monitoring data, a binary image of the scatter plot is inputted into the computer program. Afterwards, the binary image would be processed by Gaussian blur and image binarization techniques, and then the continuous points could be identified. After constant adjustment of the vertical ordinate range and introducing Cuckoo Search (CS) algorithm, the optimal process line identification and outlier detection were finally completed. The case studies demonstrate the proposed method can enhance the efficiency of outlier detection.
An automatic data process line identification method for dam safety monitoring data outlier detection
Zheng, Sen (author) / Shao, Chenfei (author) / Gu, Chongshi (author) / Xu, Yanxin (author)
2022-07-01
20 pages
Article (Journal)
Electronic Resource
English
Outlier Detection in Multivariate Hydrologic Data
| Online Contents | 2008
Outlier Detection in Multivariate Hydrologic Data
| British Library Online Contents | 2008
Outlier detection in UV/Vis spectrophotometric data
| Online Contents | 2017
Research on Outlier Detection Methods for Dam Monitoring Data Based on Post-Data Classification
| DOAJ | 2024