City Research Online

Deep Multi-Agent Reinforcement Learning for Cost Efficient Distributed LoadFrequency Control

Rozada, S., Apostolopoulou, D. and Alonso, E. ORCID: 0000-0002-3306-695X (2021). Deep Multi-Agent Reinforcement Learning for Cost Efficient Distributed LoadFrequency Control. IET Energy Systems Integration,

Abstract

The rise of microgrid-based architectures is heavily modifying the energy control landscape in distribution systems. Decentralised control mechanisms are needed to ensure reliable power system operations. We propose using Reinforcement Learning to implement load frequency control without requiring a centralised authority. Specifically, we approximate the optimal solution using Multi-Agent Deep Deterministic Policy Gradient (MADDPG) at all levels: primary, secondary and tertiary. Generation units are characterized as agents that learn how to maximize their long-term performance by acting and interacting with the environment to balance generation and load, thus restoring frequency. We prove numerically that our Reinforcement Learning methodology can be used to implement the load frequency control in a decentralised way, even when more than one balancing authority is considered.

Publication Type: Article
Publisher Keywords: Reinforcement Learning, MADDPG, Droop Control, Automatic Generation Control, Economic Dispatch, Load Frequency Control
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
T Technology > TK Electrical engineering. Electronics Nuclear engineering
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
Date available in CRO: 21 Jun 2021 13:54
Date deposited: 21 June 2021
Date of acceptance: 21 June 2021
URI: https://openaccess.city.ac.uk/id/eprint/26310
[img]
Preview
Text - Published Version
Available under License Creative Commons: Attribution International Public License 4.0.

Download (583kB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login