Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Assessing the impact of missing data on water quality index estimation: a machine learning approach
AbstractDespite the regulations and controls implemented worldwide by governments and institutions to ensure the availability and quality of water resources, many water sources remain susceptible to contamination. This contamination poses significant risks to human health and can lead to substantial economic losses. One of the challenges in this context is the presence of missing or incomplete data, which can arise from various factors such as the methodology used or the expertise of personnel involved in sample collection and analysis. The existence of such data gaps hampers the accurate analysis that can be conducted. To address this issue and estimate a water quality index from the available samples, it is crucial to handle missing information appropriately to avoid biased calculations. This study focuses on the application of machine learning methods for imputing missing data in water samples. Furthermore, it quantifies the performance of different models based on the distribution of the obtained data. By applying 10 distinct methods to a sample of water quality data, the most effective approaches, namely Bayesian Ridge, Gradient Boosting, Ridge, Support Vector Machine, and Theil-Sen regressors, were identified. The selection of these models was based on the evaluation of two estimation error metrics: average percent bias (PBIAS) and Kling-Gupta Efficiency statistic (KGEss). The respective metric values for the aforementioned methods are as follows: $$\langle \hbox {PBIAS}\rangle _{0.5}=14.665, 19.555, 14.300, 15.380, 15.920$$ ⟨ PBIAS ⟩ 0.5 = 14.665 , 19.555 , 14.300 , 15.380 , 15.920 and $$\langle \hbox {KGEss}\rangle _{0.5}=0.670, 0.585, 0.655, 0.620, 0.595$$ ⟨ KGEss ⟩ 0.5 = 0.670 , 0.585 , 0.655 , 0.620 , 0.595 . The results obtained from these models have been utilized to establish unbiased relationships among physical, chemical, and biological parameters based on the information retrieved through the applied imputation methods.
Assessing the impact of missing data on water quality index estimation: a machine learning approach
AbstractDespite the regulations and controls implemented worldwide by governments and institutions to ensure the availability and quality of water resources, many water sources remain susceptible to contamination. This contamination poses significant risks to human health and can lead to substantial economic losses. One of the challenges in this context is the presence of missing or incomplete data, which can arise from various factors such as the methodology used or the expertise of personnel involved in sample collection and analysis. The existence of such data gaps hampers the accurate analysis that can be conducted. To address this issue and estimate a water quality index from the available samples, it is crucial to handle missing information appropriately to avoid biased calculations. This study focuses on the application of machine learning methods for imputing missing data in water samples. Furthermore, it quantifies the performance of different models based on the distribution of the obtained data. By applying 10 distinct methods to a sample of water quality data, the most effective approaches, namely Bayesian Ridge, Gradient Boosting, Ridge, Support Vector Machine, and Theil-Sen regressors, were identified. The selection of these models was based on the evaluation of two estimation error metrics: average percent bias (PBIAS) and Kling-Gupta Efficiency statistic (KGEss). The respective metric values for the aforementioned methods are as follows: $$\langle \hbox {PBIAS}\rangle _{0.5}=14.665, 19.555, 14.300, 15.380, 15.920$$ ⟨ PBIAS ⟩ 0.5 = 14.665 , 19.555 , 14.300 , 15.380 , 15.920 and $$\langle \hbox {KGEss}\rangle _{0.5}=0.670, 0.585, 0.655, 0.620, 0.595$$ ⟨ KGEss ⟩ 0.5 = 0.670 , 0.585 , 0.655 , 0.620 , 0.595 . The results obtained from these models have been utilized to establish unbiased relationships among physical, chemical, and biological parameters based on the information retrieved through the applied imputation methods.
Assessing the impact of missing data on water quality index estimation: a machine learning approach
Discov Water
Sierra-Porta, David (Autor:in)
Discover Water ; 4
14.03.2024
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Assessing the impact of missing data on water quality index estimation: a machine learning approach
| DOAJ | 2024
Water-Quality Data Imputation with a High Percentage of Missing Values: A Machine Learning Approach
| DOAJ | 2021
APPLICATION OF MACHINE LEARNING TO FILL IN THE MISSING MONITORING DATA OF AIR QUALITY
| BASE | 2018
A Machine Learning-Based Framework for Water Quality Index Estimation in the Southern Bug River
| DOAJ | 2023