Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Automatic Multi‐label Classification of Bridge Components and Defects Based on Inspection Photographs
AbstractWhen performing visual inspections of bridges, experts collect photographs of defects to assess the overall condition of the structure and schedule maintenance plans. Such inspections are labor‐intensive, and computer vision‐based systems are being investigated as automated tools to assist the experts in their inspections. An important aspect however remains to ensure the representativeness of the data accounting for the sheer size, complexity and variety of the bridge components and defects being reported. Here, we perform a multi‐label classification on a dataset (SOFIA dataset) that consists of 139,455 images of types of bridge components and defects among which 53,805 are labeled (13 classes for each type). The dataset containing class imbalance and noisy labeling is processed using visual embedding computed from unsupervised deep learning methods. A combination of class‐balancing techniques is investigated on the state‐of‐the‐art Vision Transformer model. Interclass relations, which determine whether a class of defect should be part of a class of bridge component, are implemented with an additional filtering step. The whole method is also deployed on the CODEBRIM benchmark dataset resulting in an improved accuracy score.
Automatic Multi‐label Classification of Bridge Components and Defects Based on Inspection Photographs
AbstractWhen performing visual inspections of bridges, experts collect photographs of defects to assess the overall condition of the structure and schedule maintenance plans. Such inspections are labor‐intensive, and computer vision‐based systems are being investigated as automated tools to assist the experts in their inspections. An important aspect however remains to ensure the representativeness of the data accounting for the sheer size, complexity and variety of the bridge components and defects being reported. Here, we perform a multi‐label classification on a dataset (SOFIA dataset) that consists of 139,455 images of types of bridge components and defects among which 53,805 are labeled (13 classes for each type). The dataset containing class imbalance and noisy labeling is processed using visual embedding computed from unsupervised deep learning methods. A combination of class‐balancing techniques is investigated on the state‐of‐the‐art Vision Transformer model. Interclass relations, which determine whether a class of defect should be part of a class of bridge component, are implemented with an additional filtering step. The whole method is also deployed on the CODEBRIM benchmark dataset resulting in an improved accuracy score.
Automatic Multi‐label Classification of Bridge Components and Defects Based on Inspection Photographs
ce papers
Pâques, Matthieu (Autor:in) / Law‐Hine, Didier (Autor:in) / Hamedane, Otmane Alami (Autor:in) / Magnaval, Gauthier (Autor:in) / Allezard, Nicolas (Autor:in)
ce/papers ; 6 ; 1080-1086
01.09.2023
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Inspection needs of deteriorating bridge components
| British Library Conference Proceedings | 2010
Automatic Multi-Label Image Classification Model for Construction Site Images
| BASE | 2019