higher-order linear dynamical systems
TRANSCRIPT
![Page 1: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/1.jpg)
Higher-order linear dynamical systems
Kay Henning Brodersen
Computational Neuroeconomics Group Department of Economics, University of Zurich
Machine Learning and Pattern Recognition Group Department of Computer Science, ETH Zurich
http://people.inf.ethz.ch/bkay
![Page 2: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/2.jpg)
2
Outline
1 Solving higher-order systems
2 Asymptotic stability: necessary condition
3 Asymptotic stability: necessary and sufficient condition
4 Oscillations
5 Delayed feedback
The material in these slides follows: H R Wilson (1999). Spikes, Decisions, and Actions: The Dynamical Foundations of Neuroscience. Oxford University Press.
![Page 3: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/3.jpg)
3
Outline
1 Solving higher-order systems
2 Asymptotic stability: necessary condition
3 Asymptotic stability: necessary and sufficient condition
4 Oscillations
5 Delayed feedback
![Page 4: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/4.jpg)
4
Theorem 4: solving higher-order systems
![Page 5: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/5.jpg)
5
Example: a network of three nodes
Theorem 4 tells us that the states πΈπ will all have the form:
where β8 and β3.5 + 14.7π and β3.5 β 14.7π are the three eigenvalues of the system.
![Page 6: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/6.jpg)
6
Example: solving vs. characterizing the system
From Chapter 3 we know that the eqilibrium point of this system
β’ must be a spiral point (because the eigenvalues are a complex conjugate pair)
β’ must be asymptotically stable (because the real part of the eigenvalues is negative)
spiral point node saddle point centre
eig([-5 -10 7; 7 -5 -10; -10 7 -5]) ans = -3.5 + 14.72243i -3.5 - 14.72243i -8
Whether or not we care to solve for the constants, we can use the eigenvalues to characterize the system:
http://demonstrations.wolfram.com/TwoDimensionalLinearSystems/
![Page 7: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/7.jpg)
7
Outline
1 Solving higher-order systems
2 Asymptotic stability: necessary condition
3 Asymptotic stability: necessary and sufficient condition
4 Oscillations
5 Delayed feedback
![Page 8: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/8.jpg)
8
Theorem 5: a simple necessary condition for asymptotic stability
![Page 9: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/9.jpg)
9
Example: testing the necessary condition
To check the condition from Theorem 5, we write down the characteristic equation:
π΄ β ππΌ = 0
β5 β10 77 β5 β10β10 7 β5
β π1 0 00 1 00 0 1
= 0
π3 + 15 π1>0
π2 + 285 π2>0
π + 1832π3>0
= 0
Thus, a necessary condition for asymptotic stability is fulfilled.
![Page 10: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/10.jpg)
10
Outline
1 Solving higher-order systems
2 Asymptotic stability: necessary condition
3 Asymptotic stability: necessary and sufficient condition
4 Oscillations
5 Delayed feedback
![Page 11: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/11.jpg)
11
Theorem 6: a simple equivalence of asymptotic stability
![Page 12: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/12.jpg)
12
Example: testing the equivalence condition
To evaluate the condition in Theorem 6, we consider three determinants:
Ξ1 = π1 = 15 >0
Ξ2 =π1 1π3 π2
=15 11832 285
= 2443>0
Ξ3 = π3Ξ2 = 1832 β 2443 = 4475576>0
Thus, the sufficient condition for asymptotic stability is fulfilled.
time [s]
![Page 13: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/13.jpg)
13
Outline
1 Solving higher-order systems
2 Asymptotic stability: necessary condition
3 Asymptotic stability: necessary and sufficient condition
4 Oscillations
5 Delayed feedback
![Page 14: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/14.jpg)
14
Theorem 7: how to check for oscillations
![Page 15: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/15.jpg)
15
Example: checking for oscillations
To evaluate whether this system will produce oscillations, we consider two determinants:
Ξ1 = π1 = 15 >0
Ξ2 =π1 1π3 π2
=15 11832 285
= 2443=0
Thus, this dynamical system will not produce oscillations. (Note that we knew this already
from the fact that the system had an asymptotically stable equilibrium point.)
![Page 16: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/16.jpg)
16
Example: enforcing oscillations (1)
To find out under what conditions this system will produce oscillations, we require that:
Ξ1 = π1 > 0
Ξ2 =π1 1π3 π2
= 0
The above coefficients are obtained from the characteristic equation:
π΄ β ππΌ = 0
π3 + 15 π1
π2 + 21π + 75π2
π + π3 + 105π β 218π3
= 0
![Page 17: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/17.jpg)
17
Example: enforcing oscillations (2)
Thus, we wish to find π such that:
Ξ1 = 15 > 0
Ξ2 =15 1
π3 + 105π β 218 21π + 75= 0
To satsify the second equation, we require that:
15 21π + 75 β π3 + 105π β 218 = 0
π3 β 210π β 1343 = 0
This equation has 1 real solution: π = 17.
![Page 18: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/18.jpg)
18
Example: enforcing oscillations (3)
We can use MATLAB to do the above calculations:
>> A = '[-5 -g 7; 7 -5 -g; -g 7 -5]'; >> routh_hurwitz(A) g = 17.0000 Characteristic_Eqn = 1.0e+03 * 0.0010 0.0150 0.4320 6.4800 EigenValues = 0 +20.7846i 0 -20.7846i -15.0000 RHDeterminants = 15.0000 0 0.0000 ans = Solution oscillates around equilibrium point, which is a center.
Thus, our system is described by:
π
ππ‘
πΈ1πΈ2πΈ3
=β5 β17 77 β5 β17β17 7 β5
πΈ1πΈ2πΈ3
-17
The states have the general form:
πΈπ = π΄πβ15π‘ + π΅ cos 20.78π‘
+πΆ sin 20.78π‘
Oscillation frequency: 3.3 Hz
![Page 19: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/19.jpg)
19
Example: enforcing oscillations (4)
time [s]
-17
![Page 20: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/20.jpg)
20
Outline
1 Solving higher-order systems
2 Asymptotic stability: necessary condition
3 Asymptotic stability: necessary and sufficient condition
4 Oscillations
5 Delayed feedback
![Page 21: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/21.jpg)
21
Can oscillations even occur in a simpler two-region network? We consider a simple negative feedback loop:
Oscillations in a two-region network?
πΈ πΌ
π/ππΌ
βπ/ππΈ βπΈ/ππΈ βπΌ/ππΌ
The characteristic equation is:
β1/ππΈ βπ/ππΈπ/ππΌ β1/ππΌ
β ππΌ = 0
The equation is satisfied by a complex conjugate pair of eigenvalues:
π = β1
2
1
ππΈ+1
ππΌΒ±ππΈ β ππΌ
2 β 4ππππΈππΌ2ππΈππΌ
Since the real parts are negative, all solutions must be decaying exponential functions of time, and so oscillations are impossible in this model. But this does not preclude oscillations in second-order systems in generalβ¦
![Page 22: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/22.jpg)
22
Consider a two-region feedback loop with delayed inhibitory feedback:
Delayed feedback: an approximation
πΈ πΌ
Systems with true delays become exceptionally complex. Instead, we can approximate the effect of delayed feedback by introducing an additional node:
πΈ πΌ
Ξ
![Page 23: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/23.jpg)
23
Let us specify concrete numbers for all connection strengths, except for the delay:
Delayed feedback: enforcing oscillations
πΈ πΌ
Ξ
8/50
β1/5 β1/10 β1/50
β1/πΏ
1/πΏ
Is there a value for πΏ that produces oscillations?
>> routh_hurwitz('[-1/10 0 -1/5; 8/50 -1/50 0; 0 1/g -1/g]',10) g = 7.6073 Solution oscillates around equilibrium point, which is a center.
time [ms]
![Page 24: Higher-order linear dynamical systems](https://reader034.vdocuments.us/reader034/viewer/2022052412/558423c7d8b42a0b6d8b45cf/html5/thumbnails/24.jpg)
24
Summary
Preparations write down system dynamics in normal form
write down characteristic equation turn into coefficients form
What are we interested in?
Want to fully solve the system
apply theorem 5 (necessary condition)
combine with initial conditions to solve for constants π΄π
Want to quickly check for asymptotic stability
Want to check for, or enforce, oscillations
apply theorem 4 to find eigenvalues π (may be computationally expensive)
condition not satisfied β not stable
condition satisfied
apply theorem 6 (sufficient condition)
condition not satisfied β not stable
condition satisfied β system is stable
apply theorem 7 (necessary and sufficient condition)