A platform for research: civil engineering, architecture and urbanism
Autonomous dimensional inspection and issue tracking of rebar using semantically enriched 3D models
Abstract Accurate and efficient inspection of rebar dimensions has proven to be a persistent challenge for researchers and practitioners. This paper introduces a semantically enriched 3D model-based system that employs computer vision and deep learning for location-aware identification and tracking of rebar issues. The system comprises four modules: (A) digital twin generation, (B) segmentation, (C) inspection, and (D) issue identification and tracking. The generation module constructs 3D models from rebar structures. The segmentation and inspection modules analyze the 3D models, enriching them with semantic information. The issue identification and tracking module exchanges information between the semantically enriched 3D models and the building information models across time. An experiment on a column rebar cage is conducted. A precision of over 90% and a recall of over 97% are reported in 3D instance segmentation. Diameter inspection achieves an accuracy of 95.5% for large-size rebars. Spacing inspection achieves a mean relative error of 0.98%. The defective spacing is identified and tracked.
Highlights Fuses deep learning and computer vision to construct 3D semantic rebar model. BIM- and digital-twin-based information system fulfills rebar quality control. Autonomous rebar inspection pipeline directly generates issue reports from images.
Autonomous dimensional inspection and issue tracking of rebar using semantically enriched 3D models
Abstract Accurate and efficient inspection of rebar dimensions has proven to be a persistent challenge for researchers and practitioners. This paper introduces a semantically enriched 3D model-based system that employs computer vision and deep learning for location-aware identification and tracking of rebar issues. The system comprises four modules: (A) digital twin generation, (B) segmentation, (C) inspection, and (D) issue identification and tracking. The generation module constructs 3D models from rebar structures. The segmentation and inspection modules analyze the 3D models, enriching them with semantic information. The issue identification and tracking module exchanges information between the semantically enriched 3D models and the building information models across time. An experiment on a column rebar cage is conducted. A precision of over 90% and a recall of over 97% are reported in 3D instance segmentation. Diameter inspection achieves an accuracy of 95.5% for large-size rebars. Spacing inspection achieves a mean relative error of 0.98%. The defective spacing is identified and tracked.
Highlights Fuses deep learning and computer vision to construct 3D semantic rebar model. BIM- and digital-twin-based information system fulfills rebar quality control. Autonomous rebar inspection pipeline directly generates issue reports from images.
Autonomous dimensional inspection and issue tracking of rebar using semantically enriched 3D models
Chang, Chun-Cheng (author) / Huang, Tsung-Wei (author) / Chen, Yi-Hsiang (author) / Lin, Jacob J. (author) / Chen, Chuin-Shan (author)
2024-01-29
Article (Journal)
Electronic Resource
English
Towards preservation of semantically enriched architectural knowledge
Fraunhofer Publica | 2013
|Towards Optimal Planning for Green, Smart, and Semantically Enriched Cultural Tours
DOAJ | 2022
|Rebar inspection integrating augmented reality and laser scanning
Elsevier | 2022
|