Deep Multi-Agent Reinforcement Learning for Cost Efficient Distributed LoadFrequency Control
Rozada, S., Apostolopoulou, D. & Alonso, E. ORCID: 0000-0002-3306-695X (2021). Deep Multi-Agent Reinforcement Learning for Cost Efficient Distributed LoadFrequency Control. IET Energy Systems Integration, 3(3), pp. 327-343. doi: 10.1049/esi2.12030
Abstract
The rise of microgrid-based architectures is heavily modifying the energy control landscape in distribution systems. Decentralised control mechanisms are needed to ensure reliable power system operations. We propose using Reinforcement Learning to implement load frequency control without requiring a centralised authority. Specifically, we approximate the optimal solution using Multi-Agent Deep Deterministic Policy Gradient (MADDPG) at all levels: primary, secondary and tertiary. Generation units are characterized as agents that learn how to maximize their long-term performance by acting and interacting with the environment to balance generation and load, thus restoring frequency. We prove numerically that our Reinforcement Learning methodology can be used to implement the load frequency control in a decentralised way, even when more than one balancing authority is considered.
Publication Type: | Article |
---|---|
Additional Information: | This is an Open Access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. Copyright the authors, 2021. |
Publisher Keywords: | Reinforcement Learning, MADDPG, Droop Control, Automatic Generation Control, Economic Dispatch, Load Frequency Control |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > TK Electrical engineering. Electronics Nuclear engineering |
Departments: | School of Science & Technology > Computer Science |
SWORD Depositor: |
Available under License Creative Commons: Attribution International Public License 4.0.
Download (3MB) | Preview
Export
Downloads
Downloads per month over past year