A platform for research: civil engineering, architecture and urbanism
Multispectral water leakage detection based on a one-stage anchor-free modality fusion network for metro tunnels
Abstract Water leakage detection has remained one of the high-priority research topics for metro tunnel inspection. Previous research mainly uses a single visible light camera as a sensor to detect the leakage regions in the image, which is extremely sensitive to inadequate illumination inside the tunnel. To robustly and accurately detect these water leakage defects in metro tunnels, we propose a novel detection method based on multispectral modality fusion that combines the advantages of visual-optical (VIS) and thermal infrared (IR) sensors. First, a multispectral data collection system is designed, and a four-dimensional water leakage dataset containing 1840 pictures is collected and labeled. Second, a simple and efficient one-stage anchor-free multispectral modality fusion network is proposed for water leakage detection. The proposed method consists of single-modality feature extraction and multimodality feature fusion based on a feature pyramid network (FPN). Finally, the VIS/IR single modality verification experiment proves that the VIS/IR based detector has unavoidable disadvantages in water leakage detection. The multispectral detection experiment proves that our proposed modality fusion detector achieves an approximately 3.35% lower average miss rate than the state-of-the-art method and can accurately and robustly detect leakage defects not affected by light conditions.
Graphical abstract Water leakage detection has remained one of the high-priority research topics for metro tunnel inspection. Previous research mainly uses a single visible light camera as a sensor to detect the leakage regions in the image, which is extremely sensitive to inadequate illumination inside the tunnel. To robustly and accurately detect these water leakage defects in metro tunnels, we propose a novel detection method based on multispectral modality fusion that combines the advantages of visual-optical (VIS) and thermal infrared (IR) sensors. First, a multispectral data collection system is designed, and a four-dimensional water leakage dataset containing 1840 pictures is collected and labeled. Second, a simple and efficient one-stage anchor-free multispectral modality fusion network is proposed for water leakage detection. The proposed method consists of single-modality feature extraction and multimodality feature fusion based on a feature pyramid network (FPN). Finally, the VIS/IR single modality verification experiment proves that the VIS/IR based detector has unavoidable disadvantages in water leakage detection. The multispectral detection experiment proves that our proposed modality fusion detector achieves an approximately 3.35% lower average miss rate than the state-of-the-art method and can accurately and robustly detect leakage defects not affected by light conditions. Display Omitted
Highlights Developing a multispectral method to detect water leakage for metro tunnels. Developing a four-dimensional metro tunnel water leakage dataset. One-stage anchor-free multispectral modality fusion detection network was proposed. Experiment shows that multispectral is a promising application in leakage detection.
Multispectral water leakage detection based on a one-stage anchor-free modality fusion network for metro tunnels
Abstract Water leakage detection has remained one of the high-priority research topics for metro tunnel inspection. Previous research mainly uses a single visible light camera as a sensor to detect the leakage regions in the image, which is extremely sensitive to inadequate illumination inside the tunnel. To robustly and accurately detect these water leakage defects in metro tunnels, we propose a novel detection method based on multispectral modality fusion that combines the advantages of visual-optical (VIS) and thermal infrared (IR) sensors. First, a multispectral data collection system is designed, and a four-dimensional water leakage dataset containing 1840 pictures is collected and labeled. Second, a simple and efficient one-stage anchor-free multispectral modality fusion network is proposed for water leakage detection. The proposed method consists of single-modality feature extraction and multimodality feature fusion based on a feature pyramid network (FPN). Finally, the VIS/IR single modality verification experiment proves that the VIS/IR based detector has unavoidable disadvantages in water leakage detection. The multispectral detection experiment proves that our proposed modality fusion detector achieves an approximately 3.35% lower average miss rate than the state-of-the-art method and can accurately and robustly detect leakage defects not affected by light conditions.
Graphical abstract Water leakage detection has remained one of the high-priority research topics for metro tunnel inspection. Previous research mainly uses a single visible light camera as a sensor to detect the leakage regions in the image, which is extremely sensitive to inadequate illumination inside the tunnel. To robustly and accurately detect these water leakage defects in metro tunnels, we propose a novel detection method based on multispectral modality fusion that combines the advantages of visual-optical (VIS) and thermal infrared (IR) sensors. First, a multispectral data collection system is designed, and a four-dimensional water leakage dataset containing 1840 pictures is collected and labeled. Second, a simple and efficient one-stage anchor-free multispectral modality fusion network is proposed for water leakage detection. The proposed method consists of single-modality feature extraction and multimodality feature fusion based on a feature pyramid network (FPN). Finally, the VIS/IR single modality verification experiment proves that the VIS/IR based detector has unavoidable disadvantages in water leakage detection. The multispectral detection experiment proves that our proposed modality fusion detector achieves an approximately 3.35% lower average miss rate than the state-of-the-art method and can accurately and robustly detect leakage defects not affected by light conditions. Display Omitted
Highlights Developing a multispectral method to detect water leakage for metro tunnels. Developing a four-dimensional metro tunnel water leakage dataset. One-stage anchor-free multispectral modality fusion detection network was proposed. Experiment shows that multispectral is a promising application in leakage detection.
Multispectral water leakage detection based on a one-stage anchor-free modality fusion network for metro tunnels
Han, Lei (author) / Chen, Jiangfan (author) / Li, Haobo (author) / Liu, Genshuo (author) / Leng, Biao (author) / Ahmed, Ammar (author) / Zhang, Zutao (author)
2022-05-10
Article (Journal)
Electronic Resource
English
Disaster Mitigation in Metro Tunnels
British Library Conference Proceedings | 2003
|Metro tunnels under the Vltava River
British Library Conference Proceedings | 2003
|Delhi Metro - Tunnels and stations on the 11km underground metro corridor
British Library Conference Proceedings | 2000
|Investigation of Water Leakage of Metro Segments Caused by Metro Underpass Structures
DOAJ | 2021
|