Linear-like policy iteration based optimal control for continuous-time nonlinear systems
Author(s)
Tahirovic, Adnan
Astolfi, Alessandro
Type
Journal Article
Abstract
We propose a novel strategy to construct optimal controllers for continuous-time nonlinear systems by means of linear-like techniques, provided that the optimal value function is differentiable and quadratic-like . This assumption covers a wide range of cases and holds locally around an equilibrium under mild assumptions. The proposed strategy does not require solving the Hamilton-Jacobi-Bellman equation, that is a nonlinear partial differential equation, which is known to be hard or impossible to solve. Instead, the Hamilton-Jacobi-Bellman equation is replaced with an easy-solvable state-dependent Lyapunov matrix equation. We exploit a linear-like factorization of the underlying nonlinear system and a policy-iteration algorithm to yield a linear-like policy-iteration for nonlinear systems. The proposed control strategy solves optimal nonlinear control problems in an asymptotically exact, yet still linear-like manner. We prove optimality of the resulting solution and illustrate the results via four examples.
Date Issued
2023-10
Date Acceptance
2022-12-01
Citation
IEEE Transactions on Automatic Control, 2023, 68 (10), pp.5837-5849
ISSN
0018-9286
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Start Page
5837
End Page
5849
Journal / Book Title
IEEE Transactions on Automatic Control
Volume
68
Issue
10
Copyright Statement
© 2022 The Author(s). This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
License URL
Identifier
https://ieeexplore.ieee.org/document/9969888
Publication Status
Published
Date Publish Online
2022-12-05