Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Eine Plattform für die Wissenschaft: Bauingenieurwesen, Architektur und Urbanistik
Reinforcement learning-based simulation and automation for tower crane 3D lift planning
Abstract Tower crane lift planning is important to timely provide resources to workplaces. However, previous planning approaches are still impractical because the lifting time of a plan is barely considered and the lifting path is frequently non-executable by operators. This paper describes a reinforcement learning-based method that incorporates the actuator system of a tower crane into spatio-temporal lift planning in three-dimensional virtual environments wherein various strategies of algorithm types and learning rules are tested. The results show stable and practical lift planning with a failure ratio of 3%, coordination ratio of 28%, and positive evaluation of lifting procedures by expert operators. In addition, the estimated lifting time shows a correlation of 0.6857 with the actual time from field observation. Thus, the proposed approach is promising for planning feasible lifting paths and estimating reasonable lifting times, which help generate and review lifting plans given the site conditions.
Highlights Reinforcement learning (RL) is proposed for automated lift planning of tower cranes. Mechanical and operational properties of lifting are formulated for a crane agent. Six modeling strategies are tested to train the RL agent in a virtual environment. Executable lift planning is achieved along with reasonable estimations of task time. RL-based simulation may help make and review lifting plans given site conditions.
Reinforcement learning-based simulation and automation for tower crane 3D lift planning
Abstract Tower crane lift planning is important to timely provide resources to workplaces. However, previous planning approaches are still impractical because the lifting time of a plan is barely considered and the lifting path is frequently non-executable by operators. This paper describes a reinforcement learning-based method that incorporates the actuator system of a tower crane into spatio-temporal lift planning in three-dimensional virtual environments wherein various strategies of algorithm types and learning rules are tested. The results show stable and practical lift planning with a failure ratio of 3%, coordination ratio of 28%, and positive evaluation of lifting procedures by expert operators. In addition, the estimated lifting time shows a correlation of 0.6857 with the actual time from field observation. Thus, the proposed approach is promising for planning feasible lifting paths and estimating reasonable lifting times, which help generate and review lifting plans given the site conditions.
Highlights Reinforcement learning (RL) is proposed for automated lift planning of tower cranes. Mechanical and operational properties of lifting are formulated for a crane agent. Six modeling strategies are tested to train the RL agent in a virtual environment. Executable lift planning is achieved along with reasonable estimations of task time. RL-based simulation may help make and review lifting plans given site conditions.
Reinforcement learning-based simulation and automation for tower crane 3D lift planning
Cho, SungHwan (Autor:in) / Han, SangUk (Autor:in)
10.10.2022
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Tower crane foundation, tower crane and mounting method of tower crane
| Europäisches Patentamt | 2024