A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Development of an HVAC system control method using weather forecasting data with deep reinforcement learning algorithms
https://orcid.org/0000-0002-9984-8428
https://orcid.org/0000-0001-5115-9984
Abstract Heating, ventilation, and air conditioning (HVAC) systems account for a significant proportion of the energy consumption of a building. With the global energy demand increasing every year, optimal HVAC control methods that reduce energy consumption while maintaining the thermal comfort of the occupants have become more important. Weather forecasting data have thus attracted significant research attention for the optimization of building energy consumption in model-based studies. However, these HVAC control approaches have failed to consider the reduction in the predictive error of the incorporated weather model, leading to performance limitations. Accordingly, model-free reinforcement learning (RL)-based HVAC systems that can be controlled dynamically have been proposed, and these have exhibited significantly better performance than model-based methods. However, RL algorithms using weather forecasting data have not yet been assessed for use in optimal HVAC control for buildings. In this study, we propose WDQN-temPER, a hybrid HVAC control method combining a deep Q-network with a novel prioritized experience replay (PER) technique (referred to as temPER) and a gated recurrent unit (GRU) model. The GRU model predicts the future outdoor temperature and this is used as a state variable in the RL model. The proposed temPER algorithm facilitates the use of samples in the RL training process with larger changes in the outdoor temperature based on the predicted temperature. We experimentally demonstrate in EnergyPlus simulations that our proposed WDQN-temPER model outperforms a rule-based baseline model in terms of HVAC control, with energy savings of up to 58.79%.
Highlights An HVAC control method using weather forecasting data is proposed. This method combines reinforcement learning with a weather prediction model. A temPER algorithm for managing sudden outdoor temperature changes is developed. An average energy savings of 58.79% is achieved with the WDQN-temPER model.
Development of an HVAC system control method using weather forecasting data with deep reinforcement learning algorithms
https://orcid.org/0000-0002-9984-8428
https://orcid.org/0000-0001-5115-9984
Abstract Heating, ventilation, and air conditioning (HVAC) systems account for a significant proportion of the energy consumption of a building. With the global energy demand increasing every year, optimal HVAC control methods that reduce energy consumption while maintaining the thermal comfort of the occupants have become more important. Weather forecasting data have thus attracted significant research attention for the optimization of building energy consumption in model-based studies. However, these HVAC control approaches have failed to consider the reduction in the predictive error of the incorporated weather model, leading to performance limitations. Accordingly, model-free reinforcement learning (RL)-based HVAC systems that can be controlled dynamically have been proposed, and these have exhibited significantly better performance than model-based methods. However, RL algorithms using weather forecasting data have not yet been assessed for use in optimal HVAC control for buildings. In this study, we propose WDQN-temPER, a hybrid HVAC control method combining a deep Q-network with a novel prioritized experience replay (PER) technique (referred to as temPER) and a gated recurrent unit (GRU) model. The GRU model predicts the future outdoor temperature and this is used as a state variable in the RL model. The proposed temPER algorithm facilitates the use of samples in the RL training process with larger changes in the outdoor temperature based on the predicted temperature. We experimentally demonstrate in EnergyPlus simulations that our proposed WDQN-temPER model outperforms a rule-based baseline model in terms of HVAC control, with energy savings of up to 58.79%.
Highlights An HVAC control method using weather forecasting data is proposed. This method combines reinforcement learning with a weather prediction model. A temPER algorithm for managing sudden outdoor temperature changes is developed. An average energy savings of 58.79% is achieved with the WDQN-temPER model.
Development of an HVAC system control method using weather forecasting data with deep reinforcement learning algorithms
https://orcid.org/0000-0002-9984-8428
https://orcid.org/0000-0001-5115-9984
Abstract Heating, ventilation, and air conditioning (HVAC) systems account for a significant proportion of the energy consumption of a building. With the global energy demand increasing every year, optimal HVAC control methods that reduce energy consumption while maintaining the thermal comfort of the occupants have become more important. Weather forecasting data have thus attracted significant research attention for the optimization of building energy consumption in model-based studies. However, these HVAC control approaches have failed to consider the reduction in the predictive error of the incorporated weather model, leading to performance limitations. Accordingly, model-free reinforcement learning (RL)-based HVAC systems that can be controlled dynamically have been proposed, and these have exhibited significantly better performance than model-based methods. However, RL algorithms using weather forecasting data have not yet been assessed for use in optimal HVAC control for buildings. In this study, we propose WDQN-temPER, a hybrid HVAC control method combining a deep Q-network with a novel prioritized experience replay (PER) technique (referred to as temPER) and a gated recurrent unit (GRU) model. The GRU model predicts the future outdoor temperature and this is used as a state variable in the RL model. The proposed temPER algorithm facilitates the use of samples in the RL training process with larger changes in the outdoor temperature based on the predicted temperature. We experimentally demonstrate in EnergyPlus simulations that our proposed WDQN-temPER model outperforms a rule-based baseline model in terms of HVAC control, with energy savings of up to 58.79%.
Highlights An HVAC control method using weather forecasting data is proposed. This method combines reinforcement learning with a weather prediction model. A temPER algorithm for managing sudden outdoor temperature changes is developed. An average energy savings of 58.79% is achieved with the WDQN-temPER model.
Development of an HVAC system control method using weather forecasting data with deep reinforcement learning algorithms
Shin, Minjae (author) / Kim, Sungsoo (author) / Kim, Youngjin (author) / Song, Ahhyun (author) / Kim, Yeeun (author) / Kim, Ha Young (author)
Building and Environment ; 248
2023-11-23
Article (Journal)
Electronic Resource
English
Robust deep reinforcement learning for personalized HVAC system
| Elsevier | 2024
Enhancing HVAC Control Systems Using a Steady Soft Actor–Critic Deep Reinforcement Learning Approach
| DOAJ | 2025
End-to-End Deep Reinforcement Learning Control for HVAC Systems in Office Buildings
| DOAJ | 2022