A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Optimal control of a solar-driven seasonal sorption storage system through deep reinforcement learning
Deep reinforcement learning (DRL) has demonstrated its effectiveness in the control of energy systems, although it has not yet been applied to sorption thermal energy storage (TES) systems. The operation of sorption TES systems is notably more complicated compared to other TES variants. The discharge of a sorption TES occurs at a particular desorption and evaporation temperature. Achieving a continuous and efficient discharge of a sorption TES is a challenging control task if heat required at the evaporator is obtained from the sun or the environment. Its operation is especially complicated during winter, because of the limited availability of solar irradiation and low ambient temperatures. Thus, this study analyzes for first time in the literature the competitiveness of deep reinforcement learning to control a solar-driven seasonal sorption TES system and compares it against traditional optimized rule-based control strategy. The system, located in Central Europe, supplied domestic hot water and space heating to a single-family house. Two DRL models were developed and trained to operate the system under two different sets of data: 120 winter consecutive days and 60 winter non-consecutive days. The results showed that the DRL control strategy reduced the system operational costs by 28% in a 60 winter days scenario. For a 120 winter days scenario, the operational cost savings decreased to 13% because the smart control performed worst once the sorption TES was fully discharged. These results were derived from a four-year validation data set, bolstering their robustness. The study demonstrates the successful application of DRL in controlling a solar-driven seasonal sorption TES system, yielding considerable economic savings compared to an RBC strategy. Subsequent work will consist of implementing the smart control strategy at prototype level to assess its performance. ; This work was partially funded by the Ministerio de Ciencia e Innovación - Agencia Estatal de Investigación, Spain (PID2021-123511OB-C31 - ...
Optimal control of a solar-driven seasonal sorption storage system through deep reinforcement learning
Deep reinforcement learning (DRL) has demonstrated its effectiveness in the control of energy systems, although it has not yet been applied to sorption thermal energy storage (TES) systems. The operation of sorption TES systems is notably more complicated compared to other TES variants. The discharge of a sorption TES occurs at a particular desorption and evaporation temperature. Achieving a continuous and efficient discharge of a sorption TES is a challenging control task if heat required at the evaporator is obtained from the sun or the environment. Its operation is especially complicated during winter, because of the limited availability of solar irradiation and low ambient temperatures. Thus, this study analyzes for first time in the literature the competitiveness of deep reinforcement learning to control a solar-driven seasonal sorption TES system and compares it against traditional optimized rule-based control strategy. The system, located in Central Europe, supplied domestic hot water and space heating to a single-family house. Two DRL models were developed and trained to operate the system under two different sets of data: 120 winter consecutive days and 60 winter non-consecutive days. The results showed that the DRL control strategy reduced the system operational costs by 28% in a 60 winter days scenario. For a 120 winter days scenario, the operational cost savings decreased to 13% because the smart control performed worst once the sorption TES was fully discharged. These results were derived from a four-year validation data set, bolstering their robustness. The study demonstrates the successful application of DRL in controlling a solar-driven seasonal sorption TES system, yielding considerable economic savings compared to an RBC strategy. Subsequent work will consist of implementing the smart control strategy at prototype level to assess its performance. ; This work was partially funded by the Ministerio de Ciencia e Innovación - Agencia Estatal de Investigación, Spain (PID2021-123511OB-C31 - ...
Optimal control of a solar-driven seasonal sorption storage system through deep reinforcement learning
Crespo, Alicia (author) / Gibert Llauradó, Daniel (author) / Gracia Cuesta, Alvaro de (author) / Fernàndez Camon, César (author)
2023-11-22
Article (Journal)
Electronic Resource
English
DDC:
690
Advanced Warehouse Energy Storage System Control Using Deep Supervisedand Reinforcement Learning
| BASE | 2023
D4RL: Datasets for deep data-driven reinforcement learning
| DataCite | 2024
A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning
| DOAJ | 2020