A platform for research: civil engineering, architecture and urbanism
HYBRID REINFORCEMENT LEARNING (RL) TO CONTROL A WATER DISTRIBUTION NETWORK
A method and system control a water distribution network. A database is maintained of prior states based on a residential water demand, a tank level, and an energy tariff. A current state of the water distribution network is determined. Rewards are determined and include a tank level constraint, an energy cost, and a toggle count. A query based model is used to determine a set of control points used to control a first prior state. An RL agent is trained based on the prior states and rewards. The RL agent determines a control setpoint (that changes the pump speed) that maintains the tank level, minimizes the energy cost, and complies with the toggle count. The RL agent determines time slots and selects one of the time slots. Hybrid setpoints are generated to control the water distribution network within the selected time slot.
HYBRID REINFORCEMENT LEARNING (RL) TO CONTROL A WATER DISTRIBUTION NETWORK
A method and system control a water distribution network. A database is maintained of prior states based on a residential water demand, a tank level, and an energy tariff. A current state of the water distribution network is determined. Rewards are determined and include a tank level constraint, an energy cost, and a toggle count. A query based model is used to determine a set of control points used to control a first prior state. An RL agent is trained based on the prior states and rewards. The RL agent determines a control setpoint (that changes the pump speed) that maintains the tank level, minimizes the energy cost, and complies with the toggle count. The RL agent determines time slots and selects one of the time slots. Hybrid setpoints are generated to control the water distribution network within the selected time slot.
HYBRID REINFORCEMENT LEARNING (RL) TO CONTROL A WATER DISTRIBUTION NETWORK
HYBRIDES VERSTÄRKUNGSLERNEN (RL) ZUR STEUERUNG EINES WASSERVERTEILUNGSNETZES
APPRENTISSAGE PAR RENFORCEMENT HYBRIDE (RL) POUR COMMANDER UN RÉSEAU DE DISTRIBUTION D'EAU
ZHOU YUAN (author) / WANG SHU (author) / PATEL HARSH BAKULCHANDRA (author) / PENNELL MICHAEL (author) / LUO JIELIANG (author) / LAMB ALEXANDER (author)
2025-01-15
Patent
Electronic Resource
English
IPC:
G06Q
Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke
,
DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES
/
E03B
Anlagen oder Verfahren zum Gewinnen, Sammeln oder Verteilen von Wasser
,
INSTALLATIONS OR METHODS FOR OBTAINING, COLLECTING, OR DISTRIBUTING WATER
/
G05B
Steuer- oder Regelsysteme allgemein
,
CONTROL OR REGULATING SYSTEMS IN GENERAL
/
G06N
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
,
Rechnersysteme, basierend auf spezifischen Rechenmodellen
Decentralized control in active distribution grids via supervised and reinforcement learning
DOAJ | 2024
|