A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Model-based offline reinforcement learning framework for optimizing tunnel boring machine operation
Research on automation and intelligent operation of tunnel boring machine (TBM) is receiving more and more attention, benefiting from the increasing construction data. However, most studies on TBM operations optimization were trained by the labels of human drivers’ decisions, which were subjective and stochastic. As a result, the control parameters suggested by these models could hardly surpass the performance of a human driver, even the possibility of subjective incorrect decisions. Considering that the geomechanical feedback to TBM under drivers’ actions is objective, in this paper, a transformer-based model called the geological response for tunnel boring machine (GRTBM), is proposed to learn the relationship between operation-adjust and TBM monitoring changes. Additionally, with the model-based offline reinforcement learning, this paper provided a novel approach to optimizing the TBM excavation operations. The decision processes, recorded in the Yin-song TBM project for a waterway tunnel in Jilin Province of China, were used for the validation of the model. By adopting an implicit perception of geological conditions in the GRTBM model, the suggested method achieved the desired state within a single action, greatly outperformed the practical adjustments where 500 s were taken, revealing the fact that the proposed model has the potential to surpass the capability of human beings.
Model-based offline reinforcement learning framework for optimizing tunnel boring machine operation
Research on automation and intelligent operation of tunnel boring machine (TBM) is receiving more and more attention, benefiting from the increasing construction data. However, most studies on TBM operations optimization were trained by the labels of human drivers’ decisions, which were subjective and stochastic. As a result, the control parameters suggested by these models could hardly surpass the performance of a human driver, even the possibility of subjective incorrect decisions. Considering that the geomechanical feedback to TBM under drivers’ actions is objective, in this paper, a transformer-based model called the geological response for tunnel boring machine (GRTBM), is proposed to learn the relationship between operation-adjust and TBM monitoring changes. Additionally, with the model-based offline reinforcement learning, this paper provided a novel approach to optimizing the TBM excavation operations. The decision processes, recorded in the Yin-song TBM project for a waterway tunnel in Jilin Province of China, were used for the validation of the model. By adopting an implicit perception of geological conditions in the GRTBM model, the suggested method achieved the desired state within a single action, greatly outperformed the practical adjustments where 500 s were taken, revealing the fact that the proposed model has the potential to surpass the capability of human beings.
Model-based offline reinforcement learning framework for optimizing tunnel boring machine operation
Yupeng Cao (author) / Wei Luo (author) / Yadong Xue (author) / Weiren Lin (author) / Feng Zhang (author)
2024
Article (Journal)
Electronic Resource
Unknown
Metadata by DOAJ is licensed under CC BY-SA 1.0
Model-based offline reinforcement learning framework for optimizing tunnel boring machine operation
| Elsevier | 2024
Tunnel Boring Machine Development
| British Library Conference Proceedings | 2008
Engineering Index Backfile | 1955
A model of tunnel boring machine performance
| Online Contents | 1992