July 31, 2024
Conference Paper

Fast Frequency Response using Reinforcement Learning-Controlled Wind Turbines

Abstract

To fulfill the auxiliary grid services such as load regulation, spin and non-spin reserve, and frequency support during emergencies, power system operators often require certain wind farms to operate in de-loaded modes. By leveraging the fast response capability of wind farms, the reserved power in deloaded modes can significantly enhance the stability and reliability of power grids. This paper presents a novel methodology that incorporates wind turbines into reinforcement learning-based solutions for frequency response. The proposed approach employs the state-of-the-art reinforcement learning algorithm, surrogategradient- based evolution strategy (GSES), for continuous control of the wind farm output. Our methodology is tested on a modified IEEE-39 bus system, and simulation outcomes demonstrate that the proposed approach can reliably support the frequency of the power system and prevent unnecessary load shedding.

Published: July 31, 2024

Citation

Gao W., R. Fan, W. Qiao, S. Wang, and W. Gao. 2023. Fast Frequency Response using Reinforcement Learning-Controlled Wind Turbines. In IEEE Industry Applications Society Annual Meeting (IAS 2023), October 29-November 2, 2023, Nashville, TN, 1-7. Piscataway, New Jersey:IEEE. PNNL-SA-188156. doi:10.1109/IAS54024.2023.10406378