A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Damage-augmented digital twins towards the automated inspection of buildings
https://orcid.org/0000-0002-3723-3882
https://orcid.org/0000-0002-6883-5157
Abstract Current procedures for the rapid inspection of buildings and infrastructure are subjective, time-consuming, and cumbersome to document, necessitating new technologies to automate the process and eliminate these shortcomings. Fortunately, recent developments in imaging devices and artificial intelligence, such as computer vision, provide the necessary tools for this, though they are not yet integrated into infrastructure applications. In this paper, we propose an end-to-end pipeline that generates damage-augmented digital twins for buildings at LOD3, including geometrical information as well as data pertaining to damage condition and its characterization. Our framework incorporates multiple-view images to (1) create a level of detail model, (2) segment damage information, and (3) characterize damage. The core of the method is the structure from motion, which is used to reconstruct the building scene, and machine-learning models that segment and characterize damage. In contrast to current practices, our method does not require manual intervention, generates lightweight models, and can be applied to a wide range of assets. The results generated with our pipeline represent a significant step towards an automated infrastructure damage assessment. We intend to expand our work in the future to include real-time applications and applications to other types of infrastructure. Codes and data sets are publicly available (https://github.com/eesd-epfl/DADT_buildings and https://doi.org/10.5281/zenodo.7767478).
Highlights A novel framework to generate Damage Augmented Digital Twins (DADT) of buildings. State-of-the-art solutions for 3D models, crack segmentation and characterization. Bench-marking data set for evaluating the automated generation of DADT of buildings.
Damage-augmented digital twins towards the automated inspection of buildings
https://orcid.org/0000-0002-3723-3882
https://orcid.org/0000-0002-6883-5157
Abstract Current procedures for the rapid inspection of buildings and infrastructure are subjective, time-consuming, and cumbersome to document, necessitating new technologies to automate the process and eliminate these shortcomings. Fortunately, recent developments in imaging devices and artificial intelligence, such as computer vision, provide the necessary tools for this, though they are not yet integrated into infrastructure applications. In this paper, we propose an end-to-end pipeline that generates damage-augmented digital twins for buildings at LOD3, including geometrical information as well as data pertaining to damage condition and its characterization. Our framework incorporates multiple-view images to (1) create a level of detail model, (2) segment damage information, and (3) characterize damage. The core of the method is the structure from motion, which is used to reconstruct the building scene, and machine-learning models that segment and characterize damage. In contrast to current practices, our method does not require manual intervention, generates lightweight models, and can be applied to a wide range of assets. The results generated with our pipeline represent a significant step towards an automated infrastructure damage assessment. We intend to expand our work in the future to include real-time applications and applications to other types of infrastructure. Codes and data sets are publicly available (https://github.com/eesd-epfl/DADT_buildings and https://doi.org/10.5281/zenodo.7767478).
Highlights A novel framework to generate Damage Augmented Digital Twins (DADT) of buildings. State-of-the-art solutions for 3D models, crack segmentation and characterization. Bench-marking data set for evaluating the automated generation of DADT of buildings.
Damage-augmented digital twins towards the automated inspection of buildings
https://orcid.org/0000-0002-3723-3882
https://orcid.org/0000-0002-6883-5157
Abstract Current procedures for the rapid inspection of buildings and infrastructure are subjective, time-consuming, and cumbersome to document, necessitating new technologies to automate the process and eliminate these shortcomings. Fortunately, recent developments in imaging devices and artificial intelligence, such as computer vision, provide the necessary tools for this, though they are not yet integrated into infrastructure applications. In this paper, we propose an end-to-end pipeline that generates damage-augmented digital twins for buildings at LOD3, including geometrical information as well as data pertaining to damage condition and its characterization. Our framework incorporates multiple-view images to (1) create a level of detail model, (2) segment damage information, and (3) characterize damage. The core of the method is the structure from motion, which is used to reconstruct the building scene, and machine-learning models that segment and characterize damage. In contrast to current practices, our method does not require manual intervention, generates lightweight models, and can be applied to a wide range of assets. The results generated with our pipeline represent a significant step towards an automated infrastructure damage assessment. We intend to expand our work in the future to include real-time applications and applications to other types of infrastructure. Codes and data sets are publicly available (https://github.com/eesd-epfl/DADT_buildings and https://doi.org/10.5281/zenodo.7767478).
Highlights A novel framework to generate Damage Augmented Digital Twins (DADT) of buildings. State-of-the-art solutions for 3D models, crack segmentation and characterization. Bench-marking data set for evaluating the automated generation of DADT of buildings.
Damage-augmented digital twins towards the automated inspection of buildings
Pantoja-Rosero, B.G. (author) / Achanta, R. (author) / Beyer, K. (author)
2023-03-11
Article (Journal)
Electronic Resource
English
Digital Twins of Stone Masonry Buildingsfor Damage Assessment
| Springer Verlag | 2023
Towards digital twins for heritage buildings: A workflow proposal
| SAGE Publications | 2023
Generation of LOD4 models for buildings towards the automated 3D modeling of BIMs and digital twins
| Elsevier | 2024