A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Quasi-autonomous bolt-loosening detection method using vision-based deep learning and image processing
Abstract In this study, a quasi-autonomous vision-based method is newly proposed for detecting loosened bolts in critical connections. The main idea of the approach is to estimate the rotational angles of bolts from the connection images by integrating deep learning technology with image processing techniques. Firstly, a regional convolutional neural network (RCNN)-based deep learning algorithm is developed to automatically detect and crop plausible bolts in the connection image. Also, the Hough line transform (HLT)-based image processing algorithm is designed to automatically estimate the bolt angles from the cropped bolt images. Secondly, the proposed vision-based approach is validated for bolt-loosening detection in a lab-scale girder connection using images captured by a smartphone camera. The accuracy of the RCNN-based bolt detector and the HLT-based bolt angle estimator are examined under different levels of perspective distortion and shooting distance. Finally, the practicality of the proposed vision-based method is verified on a real-scale girder bridge connection containing numerous bolts. The images of the connection are captured by an unmanned aerial vehicle and transferred to a computer where a quasi-autonomous bolt-loosening detection process is performed via the proposed algorithm. The experimental results demonstrate potentials of the proposed approach for quasi real-time bolt-loosening monitoring of large bolted connections. The results show that the perspective angle should not go beyond 40 degrees to ensure the accuracy of the detection results.
Highlights A vision-based bolt-loosening detection method is newly proposed. The method integrates deep learning with Hough transform to estimate bolt rotations. The method can identify bolts in an image captured under an arbitrary perspective. The method is robust in detecting small bolt-loosening severities. The method is suitable for monitoring realistic and large bolted connections.
Quasi-autonomous bolt-loosening detection method using vision-based deep learning and image processing
Abstract In this study, a quasi-autonomous vision-based method is newly proposed for detecting loosened bolts in critical connections. The main idea of the approach is to estimate the rotational angles of bolts from the connection images by integrating deep learning technology with image processing techniques. Firstly, a regional convolutional neural network (RCNN)-based deep learning algorithm is developed to automatically detect and crop plausible bolts in the connection image. Also, the Hough line transform (HLT)-based image processing algorithm is designed to automatically estimate the bolt angles from the cropped bolt images. Secondly, the proposed vision-based approach is validated for bolt-loosening detection in a lab-scale girder connection using images captured by a smartphone camera. The accuracy of the RCNN-based bolt detector and the HLT-based bolt angle estimator are examined under different levels of perspective distortion and shooting distance. Finally, the practicality of the proposed vision-based method is verified on a real-scale girder bridge connection containing numerous bolts. The images of the connection are captured by an unmanned aerial vehicle and transferred to a computer where a quasi-autonomous bolt-loosening detection process is performed via the proposed algorithm. The experimental results demonstrate potentials of the proposed approach for quasi real-time bolt-loosening monitoring of large bolted connections. The results show that the perspective angle should not go beyond 40 degrees to ensure the accuracy of the detection results.
Highlights A vision-based bolt-loosening detection method is newly proposed. The method integrates deep learning with Hough transform to estimate bolt rotations. The method can identify bolts in an image captured under an arbitrary perspective. The method is robust in detecting small bolt-loosening severities. The method is suitable for monitoring realistic and large bolted connections.
Quasi-autonomous bolt-loosening detection method using vision-based deep learning and image processing
Huynh, Thanh-Canh (author) / Park, Jae-Hyung (author) / Jung, Hyung-Jo (author) / Kim, Jeong-Tae (author)
2019-05-15
Article (Journal)
Electronic Resource
English
Bolt-loosening identification of bolt connections by vision image-based technique [9804-38]
British Library Conference Proceedings | 2016