A platform for research: civil engineering, architecture and urbanism
Automated semantic segmentation of bridge components from large-scale point clouds using a weighted superpoint graph
Abstract Deep learning techniques have the potential to provide versatile solutions for automated semantic segmentation of bridge point clouds, but previous studies were limited to small-scale bridge point clouds and focused on limited bridge component categories due to training sample scarcity. Additionally, no prior work considered the intrinsic data imbalance problem in the bridge dataset, with the points unequally distributed between the various components. This paper presents a weighted superpoint graph (WSPG) method, where bridge point clouds were firstly clustered into hundreds of semantically homogeneous superpoints that were then classified into different bridge components using PointNet and Graph Neural Networks. The WSPG method can recognize components directly from large-scale bridge point clouds and alleviate the data imbalance by leveraging a novel loss function that assigns weights according to the number of points contained in different bridge components. The effectiveness of the method was validated on both a real-world dataset with 5 categories of bridge components and a synthetic dataset with 8 categories of bridge components. Experiment results on the real-world dataset showed that the WSPG model achieved the best performance on all overall evaluation metrics of overall accuracy (OA: 99.43%), mean class accuracy (mAcc: 98.75%) and mean Intersection over Union (mIoU: 96.49%) compared to the existing cutting edge models such as PointNet, DGCNN and the original SPG. Additionally, the WSPG method also surpassed the cutting edge representatives in terms of mAcc and mIoU on the synthetic dataset, especially increasing the original SPG by 8.5% mAcc and 6.7% mIoU. The successful application of the proposed method will significantly improve upper-level tasks such as digital twining for existing bridges.
Highlights Establish datasets for both real-world and synthetic bridge point clouds. Present a user-friendly framework to generate synthetic point clouds from BrIMs. Propose a WSPG model to recognize bridge components from full-scale bridges. Alleviate the data imbalance between distinct components via a novel loss function.
Automated semantic segmentation of bridge components from large-scale point clouds using a weighted superpoint graph
Abstract Deep learning techniques have the potential to provide versatile solutions for automated semantic segmentation of bridge point clouds, but previous studies were limited to small-scale bridge point clouds and focused on limited bridge component categories due to training sample scarcity. Additionally, no prior work considered the intrinsic data imbalance problem in the bridge dataset, with the points unequally distributed between the various components. This paper presents a weighted superpoint graph (WSPG) method, where bridge point clouds were firstly clustered into hundreds of semantically homogeneous superpoints that were then classified into different bridge components using PointNet and Graph Neural Networks. The WSPG method can recognize components directly from large-scale bridge point clouds and alleviate the data imbalance by leveraging a novel loss function that assigns weights according to the number of points contained in different bridge components. The effectiveness of the method was validated on both a real-world dataset with 5 categories of bridge components and a synthetic dataset with 8 categories of bridge components. Experiment results on the real-world dataset showed that the WSPG model achieved the best performance on all overall evaluation metrics of overall accuracy (OA: 99.43%), mean class accuracy (mAcc: 98.75%) and mean Intersection over Union (mIoU: 96.49%) compared to the existing cutting edge models such as PointNet, DGCNN and the original SPG. Additionally, the WSPG method also surpassed the cutting edge representatives in terms of mAcc and mIoU on the synthetic dataset, especially increasing the original SPG by 8.5% mAcc and 6.7% mIoU. The successful application of the proposed method will significantly improve upper-level tasks such as digital twining for existing bridges.
Highlights Establish datasets for both real-world and synthetic bridge point clouds. Present a user-friendly framework to generate synthetic point clouds from BrIMs. Propose a WSPG model to recognize bridge components from full-scale bridges. Alleviate the data imbalance between distinct components via a novel loss function.
Automated semantic segmentation of bridge components from large-scale point clouds using a weighted superpoint graph
Yang, Xiaofei (author) / del Rey Castillo, Enrique (author) / Zou, Yang (author) / Wotherspoon, Liam (author) / Tan, Yi (author)
2022-07-29
Article (Journal)
Electronic Resource
English
A structure‐oriented loss function for automated semantic segmentation of bridge point clouds
Wiley | 2025
|Point surfel transformer network for semantic segmentation of large-scale ALS point clouds
TIBKAT | 2022
|