April 12, 2023
Conference Paper

Physics Informed Reinforcement Learning for Power Grid Control using Augmented Random Search

Abstract

Wide adoption of deep reinforcement learning need to overcome several challenges in energy system domain, including scalability, learning from limited samples, and high-dimensional continuous state and action spaces. In this paper, we integrated physics-based information from the normal generator operation state formula in the reinforcement learning agent's neural network loss function, and applied an augmented random search agent to optimize the generator control under dynamic contingency. Simulation results demonstrated the reliability performance improvements in training speed, reward convergence, sampling efficiency, scalability, and transferability.

Published: April 12, 2023

Citation

Mahapatra K., X. Fan, X. Li, Y. Huang, and Q. Huang. 2022. Physics Informed Reinforcement Learning for Power Grid Control using Augmented Random Search. In Proceedings of the 55th Hawaii International Conference on System Sciences (HICSS55), January 3-7, 2022, Virtual, Online, edited by T.X. Bui, 3498-3507. Honolulu, Hawaii:HICSS. PNNL-SA-163357. doi:10.24251/HICSS.2022.427