inversion in optimal control. principles and examplesbonnans/€¦ · control design for...
TRANSCRIPT
![Page 1: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/1.jpg)
Inversion in optimal control. Principles and examples
Nicolas PetitCentre Automatique et SystèmesÉcole des Mines de Paris
Knut Graichen – François Chaplais
![Page 2: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/2.jpg)
Outline
1. Receding horizon control (RHC - MPC)
2. Efficient trajectory parameterization
3. Examples
4. Indirect methods
Conclusions and future developments
![Page 3: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/3.jpg)
1- Receding Horizon control
![Page 4: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/4.jpg)
Bellman’s principle of optimality
Iterating the resolution
![Page 5: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/5.jpg)
In the limit
![Page 6: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/6.jpg)
Lyapunov function
![Page 7: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/7.jpg)
Practical issues
![Page 8: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/8.jpg)
2 – Efficient trajectories parameterization
Direct methods: collocation
![Page 9: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/9.jpg)
Collocation (Hargraves-Paris 1987)
Dynamic inversion (Seywald 1994)
Eliminating the control variable
![Page 10: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/10.jpg)
Eliminating the maximum number of variables (Petit, Milam, Murray, NOLCOS 01
y stands for
Instead of
r : relative degree of z1, zero dynamics, normal form, flatness
![Page 11: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/11.jpg)
Comparisons
Full collocation (Hargraves-Paris) : Ο(n+1)
Dynamic Inversion (Seywald) : Ο(n)
(proposed) Inversion : Ο(n+1- r)
Successive derivatives are required (substitutions)
Dedicated software package
(dim x=n, dim u=1)
![Page 12: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/12.jpg)
Example
![Page 13: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/13.jpg)
• Collocation• Easily computed
derivatives: B-splines• Analytic gradients• Frontend to NPSOL
Software
NTG: Mark Milam, Kudah Mushambi, Richard Murray, CalTech or: Matlab, Optim. Toolbox, Spline toolbox
![Page 14: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/14.jpg)
3 – Three examples
CalTech ducted fanMissileMobile robots
![Page 15: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/15.jpg)
CalTech Ducted Fan (M. Milam)
Control variables histories
Flat outputs : z1 et z2
![Page 16: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/16.jpg)
Trajectory optimizationMinimum time transients
« terrain avoidance »
« Half-turn »
![Page 17: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/17.jpg)
open loop
closed loopterrain avoidancesequence
CalTech Ducted Fan (see M. Milam PhD thesis)
![Page 18: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/18.jpg)
Minimum time and terrain avoidance
NTG receding horizon (update every
0.1s)
![Page 19: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/19.jpg)
Missile
Controls: αc, βc
Data: m(t), T(t)
![Page 20: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/20.jpg)
Mobile robots
![Page 21: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/21.jpg)
Mobile robots (Vissière, Petit, Martin, ACC 07)
![Page 22: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/22.jpg)
4 – Indirect methods (Chaplais, Petit, COCV 07)
![Page 23: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/23.jpg)
Solution 1: collocation+inversion
1 unknown, no differential equation
![Page 24: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/24.jpg)
Solution 2: PMP
![Page 25: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/25.jpg)
Two-point boundary value problem
![Page 26: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/26.jpg)
Solution 3: inversion of the adjoint dynamics
![Page 27: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/27.jpg)
Solution 3 (cont.)
![Page 28: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/28.jpg)
Remarkable points of solution 3
• reduction of CPU time
• post-optimal analysis
• increased accuracy
![Page 29: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/29.jpg)
![Page 30: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/30.jpg)
Post-optimal analysis
![Page 31: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/31.jpg)
![Page 32: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/32.jpg)
Numerical analysis of higher-order TPBVPs
![Page 33: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/33.jpg)
![Page 34: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/34.jpg)
Second order example (comparisons against exact solution)
![Page 35: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/35.jpg)
General result
![Page 36: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/36.jpg)
![Page 37: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/37.jpg)
![Page 38: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/38.jpg)
![Page 39: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/39.jpg)
![Page 40: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/40.jpg)
![Page 41: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/41.jpg)
![Page 42: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/42.jpg)
Dealing with input/state constraints (Knut Graichen)
![Page 43: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/43.jpg)
![Page 44: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/44.jpg)
![Page 45: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/45.jpg)
![Page 46: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/46.jpg)
Conclusions• Numerous variables can be eliminated from formulations of optimal control problems
• Direct or indirect methods
• r: relative degree plays a dual role in the adjoint dynamics
• Some constrained cases or singular arcs can be treated
![Page 47: Inversion in optimal control. Principles and examplesbonnans/€¦ · Control Design for Finite-Time Transition Problems of Nonlinear Systems with Input and Output Constraints. Doctoral](https://reader034.vdocuments.us/reader034/viewer/2022042410/5f27a4c1486d5764823902cf/html5/thumbnails/47.jpg)
Some references1.
U. M.
Ascher, R. M. M.
Mattheij,
and
R. D.
Russell.
Numerical
solution of
boundary
value
problems
for
ordinary differential equations. Prentice
Hall,
Inc.,
Englewood Cliffs, NJ, 1988.
2.
A.
Isidori.
Nonlinear
Control
Systems. Springer, New York, 2nd
edition, 1989.
3.
M. Fliess, J. Lévine, P. Martin,
and
P.
Rouchon.
Flatness and
defect
of
nonlinear systems:
introductory theory and examples.
Int. J. Control, 61(6):1327–1361, 1995.
4.
N. Petit, M. B.
Milam,
and
R. M. Murray. Inversion
based
constrained trajectory optimization. In 5th IFAC Symposium on Nonlinear
Control
Systems, 2001.
5.
M. Milam.
Real-Time Optimal
Trajectory Generation
for
Constrained Dynamical Systems. PhD thesis. California Institute
of Technology, 2003.
6.
K.
Graichen. Feedforward
Control Design for
Finite-Time
Transition
Problems
of
Nonlinear Systems with
Input
and
Output
Constraints. Doctoral
Thesis, Shaker
Verlag, 2006.
7.
F.
Chaplais and
N. Petit. Inversion in indirect optimal control
of
multivariable systems. To
appear
ESAIM COCV, 2007.