February 17, 2023
Conference Paper

Neural Lyapunov Differentiable Predictive Control

Abstract

We present a learning-based predictive control methodology using the differentiable programming framework with sufficient Lyapunov-based guarantees. The neural Lyapunov differentiable predictive control (NLDPC) learns the policy by constructing a computational graph encompassing the system dynamics, state, and input constraints, and the necessary Lyapunov certification constraints, and thereafter using the automatic differentiation to update the neural policy parameters. In conjunction, our approach jointly learns a Lyapunov function that certifies the regions of state-space with stable dynamics. We also provide an initial condition sampling-based statistical guarantee for the training of NLDPC. Our offline training approach provides a computationally efficient and scalable alternative to classical model predictive control solutions, which now directly comes with Lyapunov based guarantees as shown in this paper. We substantiate the advantages of the proposed approach with simulations to stabilize the double integrator model and on an example of controlling an aircraft model.

Published: February 17, 2023

Citation

Mukherjee S., J. Drgona, A.R. Tuor, M. Halappanavar, and D.L. Vrabie. 2022. Neural Lyapunov Differentiable Predictive Control. In Proceedings of the 61st IEEE Conference on Decision and Control (CDC 2022), December 6-9, 2022, Cancun, Mexico, 2097-2104. Piscataway, New Jersey:IEEE. PNNL-SA-171659. doi:10.1109/CDC51059.2022.9992386

Research topics