inverse problems for distributions of parameters in pde...
TRANSCRIPT
![Page 1: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/1.jpg)
Inverse Problems for Distributions of Parametersin PDE Systems
Prof. Nathan L. Gibson
Department of Mathematics
Reed College Mathematics ColloquiumNov 4, 2010
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 1 / 56
![Page 2: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/2.jpg)
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 2 / 56
![Page 3: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/3.jpg)
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 2 / 56
![Page 4: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/4.jpg)
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 2 / 56
![Page 5: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/5.jpg)
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 2 / 56
![Page 6: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/6.jpg)
Inverse Problems
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 3 / 56
![Page 7: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/7.jpg)
Inverse Problems Preliminaries
A General First Order Linear PDE System
∂u
∂t−Au = f
where u is called a state variable, A is a linear operator depending on a setof parameters q, and f is a source term.
Examples
A = c ∂∂x yields a one-way wave equation.
u = [v ,w ]T and
A =
[0 1
µ∂∂x
1ε
∂∂x 0
]yields the wave equation with speed c =
√(1/εµ).
u = [H,E ,P]T and c =√
(1/εµ)
A =1
τ
0 0 00 1− ε c0 ε−1
c −1
+
0 1µ
∂∂x 0
1ε
∂∂x 0 00 0 0
yields 1D Maxwell’s equations with Debye polarization.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 4 / 56
![Page 8: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/8.jpg)
Inverse Problems Preliminaries
A General First Order Linear PDE System
∂u
∂t−Au = f
where u is called a state variable, A is a linear operator depending on a setof parameters q, and f is a source term.Examples
A = c ∂∂x yields a one-way wave equation.
u = [v ,w ]T and
A =
[0 1
µ∂∂x
1ε
∂∂x 0
]yields the wave equation with speed c =
√(1/εµ).
u = [H,E ,P]T and c =√
(1/εµ)
A =1
τ
0 0 00 1− ε c0 ε−1
c −1
+
0 1µ
∂∂x 0
1ε
∂∂x 0 00 0 0
yields 1D Maxwell’s equations with Debye polarization.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 4 / 56
![Page 9: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/9.jpg)
Inverse Problems Preliminaries
A General First Order Linear PDE System
∂u
∂t−Au = f
where u is called a state variable, A is a linear operator depending on a setof parameters q, and f is a source term.Examples
A = c ∂∂x yields a one-way wave equation.
u = [v ,w ]T and
A =
[0 1
µ∂∂x
1ε
∂∂x 0
]yields the wave equation with speed c =
√(1/εµ).
u = [H,E ,P]T and c =√
(1/εµ)
A =1
τ
0 0 00 1− ε c0 ε−1
c −1
+
0 1µ
∂∂x 0
1ε
∂∂x 0 00 0 0
yields 1D Maxwell’s equations with Debye polarization.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 4 / 56
![Page 10: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/10.jpg)
Inverse Problems Preliminaries
A General First Order Linear PDE System
∂u
∂t−Au = f
where u is called a state variable, A is a linear operator depending on a setof parameters q, and f is a source term.Examples
A = c ∂∂x yields a one-way wave equation.
u = [v ,w ]T and
A =
[0 1
µ∂∂x
1ε
∂∂x 0
]yields the wave equation with speed c =
√(1/εµ).
u = [H,E ,P]T and c =√
(1/εµ)
A =1
τ
0 0 00 1− ε c0 ε−1
c −1
+
0 1µ
∂∂x 0
1ε
∂∂x 0 00 0 0
yields 1D Maxwell’s equations with Debye polarization.Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 4 / 56
![Page 11: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/11.jpg)
Inverse Problems Preliminaries
Forward Problem
We say the “forward problem” is to find the solution to the system forsome given value of the parameter set (and everything else is known).
For all but a simple class of PDEs, this involves numerical approximationsto discrete solutions
Ui ,j ≈ u(xi , tj).
An example of a numerical method is to replace ∂u∂x at (tj , xi ) with
Ui ,j − Ui−1,j
∆x
for some fixed ∆x = xi − xi−1. Called a finite difference.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 5 / 56
![Page 12: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/12.jpg)
Inverse Problems Preliminaries
Forward Problem
We say the “forward problem” is to find the solution to the system forsome given value of the parameter set (and everything else is known).
For all but a simple class of PDEs, this involves numerical approximationsto discrete solutions
Ui ,j ≈ u(xi , tj).
An example of a numerical method is to replace ∂u∂x at (tj , xi ) with
Ui ,j − Ui−1,j
∆x
for some fixed ∆x = xi − xi−1. Called a finite difference.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 5 / 56
![Page 13: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/13.jpg)
Inverse Problems Preliminaries
Forward Problem
We say the “forward problem” is to find the solution to the system forsome given value of the parameter set (and everything else is known).
For all but a simple class of PDEs, this involves numerical approximationsto discrete solutions
Ui ,j ≈ u(xi , tj).
An example of a numerical method is to replace ∂u∂x at (tj , xi ) with
Ui ,j − Ui−1,j
∆x
for some fixed ∆x = xi − xi−1. Called a finite difference.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 5 / 56
![Page 14: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/14.jpg)
Inverse Problems Preliminaries
Inverse Problems
Definition
An inverse problem estimates quantities indirectly by using measurementsof other quantities.
For example, a parameter estimation inverse problem attempts todetermine values of a parameter set given (discrete) observations of(some) state variables.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 6 / 56
![Page 15: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/15.jpg)
Inverse Problems Preliminaries
Inverse Problems
Definition
An inverse problem estimates quantities indirectly by using measurementsof other quantities.
For example, a parameter estimation inverse problem attempts todetermine values of a parameter set given (discrete) observations of(some) state variables.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 6 / 56
![Page 16: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/16.jpg)
Inverse Problems Preliminaries
Parameter Identification
In the context of Maxwell’s equations:
Estimate q using E (q) (not easily invertible)
Given real-life data E , use several trial values of q to compute(simulate) several E (q) values
The value of q that results in an E (q) which is a “best match” to Eis likely close to the real-life value of q.
Mathematically, find
minq∈Qad
∥∥∥error(E (q), E
)∥∥∥ .
For example, with data measured at fixed x and discrete times tj
minq∈Qad
1
N
N∑j=1
(E (tj ; q)− Ej
)2
is called the nonlinear least squares method.
Need a (fast) method for computing E .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 7 / 56
![Page 17: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/17.jpg)
Inverse Problems Preliminaries
Parameter Identification
In the context of Maxwell’s equations:
Estimate q using E (q) (not easily invertible)
Given real-life data E , use several trial values of q to compute(simulate) several E (q) values
The value of q that results in an E (q) which is a “best match” to Eis likely close to the real-life value of q.
Mathematically, find
minq∈Qad
∥∥∥error(E (q), E
)∥∥∥ .
For example, with data measured at fixed x and discrete times tj
minq∈Qad
1
N
N∑j=1
(E (tj ; q)− Ej
)2
is called the nonlinear least squares method.
Need a (fast) method for computing E .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 7 / 56
![Page 18: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/18.jpg)
Inverse Problems Preliminaries
Parameter Identification
In the context of Maxwell’s equations:
Estimate q using E (q) (not easily invertible)
Given real-life data E , use several trial values of q to compute(simulate) several E (q) values
The value of q that results in an E (q) which is a “best match” to Eis likely close to the real-life value of q.
Mathematically, find
minq∈Qad
∥∥∥error(E (q), E
)∥∥∥ .
For example, with data measured at fixed x and discrete times tj
minq∈Qad
1
N
N∑j=1
(E (tj ; q)− Ej
)2
is called the nonlinear least squares method.
Need a (fast) method for computing E .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 7 / 56
![Page 19: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/19.jpg)
Inverse Problems Preliminaries
Parameter Identification
In the context of Maxwell’s equations:
Estimate q using E (q) (not easily invertible)
Given real-life data E , use several trial values of q to compute(simulate) several E (q) values
The value of q that results in an E (q) which is a “best match” to Eis likely close to the real-life value of q.
Mathematically, find
minq∈Qad
∥∥∥error(E (q), E
)∥∥∥ .
For example, with data measured at fixed x and discrete times tj
minq∈Qad
1
N
N∑j=1
(E (tj ; q)− Ej
)2
is called the nonlinear least squares method.
Need a (fast) method for computing E .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 7 / 56
![Page 20: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/20.jpg)
Inverse Problems Preliminaries
Parameter Identification
In the context of Maxwell’s equations:
Estimate q using E (q) (not easily invertible)
Given real-life data E , use several trial values of q to compute(simulate) several E (q) values
The value of q that results in an E (q) which is a “best match” to Eis likely close to the real-life value of q.
Mathematically, find
minq∈Qad
∥∥∥error(E (q), E
)∥∥∥ .
For example, with data measured at fixed x and discrete times tj
minq∈Qad
1
N
N∑j=1
(E (tj ; q)− Ej
)2
is called the nonlinear least squares method.
Need a (fast) method for computing E .Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 7 / 56
![Page 21: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/21.jpg)
Inverse Problems Distributions
Distributions of Parameters
In many systems, the dynamics are not completely described by a singleparameter set. Often there are many different values of the parameters atwork, and we only see the average effect.
To account for the effect of possible multiple parameter sets q, we define aprobability distribution F (q).In these cases it not sufficient to use the average value of the parameters,rather one must compute all possible solutions and take the average ofthose.Example: population growth y ′ = −ry with r ∼ N (0, 1).Expected value of solutions is given by
u(t, x ;F ) =
∫QU(t, x ; q)dF (q),
where Q is some admissible set and F ∈ P(Q).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 8 / 56
![Page 22: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/22.jpg)
Inverse Problems Distributions
Distributions of Parameters
In many systems, the dynamics are not completely described by a singleparameter set. Often there are many different values of the parameters atwork, and we only see the average effect.To account for the effect of possible multiple parameter sets q, we define aprobability distribution F (q).
In these cases it not sufficient to use the average value of the parameters,rather one must compute all possible solutions and take the average ofthose.Example: population growth y ′ = −ry with r ∼ N (0, 1).Expected value of solutions is given by
u(t, x ;F ) =
∫QU(t, x ; q)dF (q),
where Q is some admissible set and F ∈ P(Q).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 8 / 56
![Page 23: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/23.jpg)
Inverse Problems Distributions
Distributions of Parameters
In many systems, the dynamics are not completely described by a singleparameter set. Often there are many different values of the parameters atwork, and we only see the average effect.To account for the effect of possible multiple parameter sets q, we define aprobability distribution F (q).In these cases it not sufficient to use the average value of the parameters,rather one must compute all possible solutions and take the average ofthose.Example: population growth y ′ = −ry with r ∼ N (0, 1).
Expected value of solutions is given by
u(t, x ;F ) =
∫QU(t, x ; q)dF (q),
where Q is some admissible set and F ∈ P(Q).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 8 / 56
![Page 24: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/24.jpg)
Inverse Problems Distributions
Distributions of Parameters
In many systems, the dynamics are not completely described by a singleparameter set. Often there are many different values of the parameters atwork, and we only see the average effect.To account for the effect of possible multiple parameter sets q, we define aprobability distribution F (q).In these cases it not sufficient to use the average value of the parameters,rather one must compute all possible solutions and take the average ofthose.Example: population growth y ′ = −ry with r ∼ N (0, 1).Expected value of solutions is given by
u(t, x ;F ) =
∫QU(t, x ; q)dF (q),
where Q is some admissible set and F ∈ P(Q).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 8 / 56
![Page 25: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/25.jpg)
Inverse Problems Distributions
Inverse Problem for F
Given data {E}j we seek to determine a probability distribution F ∗,such that
F ∗ = minF∈P(Q)
J (F ),
where, for example,
J (F ) =∑
j
(E (tj ;F )− Ej
)2.
Given a trial distribution Fk we compute E (tj ;Fk) and test J (Fk),then update Fk+1 as necessary to find a minimum.
Need either a parametrization or a discretization of Fk to have a finitedimensional problem.
Need a (fast) method for computing E (x , t;F ).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 9 / 56
![Page 26: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/26.jpg)
Maxwell’s Equations
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 10 / 56
![Page 27: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/27.jpg)
Maxwell’s Equations Description
Maxwell’s Equations
Maxwell’s Equations were
formulated circa 1870.
They represent a fundamental
unification of electric and
magnetic fields predicting
electromagnetic wave
phenomenon.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 11 / 56
![Page 28: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/28.jpg)
Maxwell’s Equations Description
Maxwell’s Equations
∂D
∂t+ J = ∇×H (Ampere)
∂B
∂t= −∇× E (Faraday)
∇ ·D = ρ (Poisson)
∇ · B = 0 (Gauss)
E = Electric field vector
H = Magnetic field vector
ρ = Electric charge density
D = Electric displacement
B = Magnetic flux density
J = Current density
Note: Need initial conditions and boundary conditions.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 12 / 56
![Page 29: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/29.jpg)
Maxwell’s Equations Description
Constitutive Laws
Maxwell’s equations are completed by constitutive laws that describe theresponse of the medium to the electromagnetic field.
D = εE + P
B = µH + M
J = σE + Js
P = Polarization
M = Magnetization
Js = Source Current
ε = Electric permittivity
µ = Magnetic permeability
σ = Electric Conductivity
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 13 / 56
![Page 30: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/30.jpg)
Maxwell’s Equations Simplifications
Linear, Isotropic, Non-dispersive and Non-conductive media
Assume no material dispersion, i.e., speed of propagation is not frequencydependent.
D = εE
B = µH
ε = ε0εr
µ = µ0µr
εr = Relative Permittivity
µr = Relative Permeability
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 14 / 56
![Page 31: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/31.jpg)
Maxwell’s Equations Simplifications
Maxwell’s Equations in One Space Dimension
The time evolution of the fields is thus completely specified by thecurl equations
ε∂E
∂t= ∇×H
µ∂H
∂t= −∇× E
Assuming that the electric field is polarized to oscillate only in the ydirection, propagate in the x direction, and there is uniformity in thez direction:
Equations involving Ey and Hz .
ε∂Ey
∂t= −∂Hz
∂x
µ∂Hz
∂t= −∂Ey
∂x
x
y
x
Ey
H z
.
..
..
..
..
..
..
..
..
..
..
.
..
..
..
..
..
..
.
.
.
.
.
.
.
.
.
.
.
..
..
..
..
..
..
..
..
..
........
......... ............
...............
.................
....................
.......................
..........................
.............................
.
.............................
..........................
.......................
....................
.................
..............
........... .........
........
..
..
..
..
..
..
..
..
..
.
.
.
.
.
.
.
.
.
.
.
.
.
..
..
.
..
..
..
..
.
..
..
..
..
..
..
..
..
..
.
..
..
..
..
..
..
..
..
..
..
.
..
..
..
..
..
..
.
.
.
.
.
.
.
.
.
.
.
..
..
..
..
..
..
..
..
..
........
......... ............
...............
.................
....................
.......................
..........................
.............................
.
.............................
..........................
.......................
....................
.................
..............
........... .........
........
..
..
..
..
..
..
..
..
..
.
.
.
.
.
.
.
.
.
.
.
.
.
..
..
.
..
..
..
..
.
..
..
..
..
..
..
..
..
..
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 15 / 56
![Page 32: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/32.jpg)
Maxwell’s Equations Discretization
The Yee Scheme
In 1966 Kane Yee originated a set of finite-difference equations for thetime dependent Maxwell’s curl equations (finite difference time domainor FDTD)
Staggered Grids: Choose E components on integer points in spaceand time, and H components on the half-grids in both variables.
Idea:First order derivatives are much more accurately evaluated onstaggered grids, such that if a variable is located on the integer grid,its first derivative is best evaluated on the half-grid and vice-versa.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 16 / 56
![Page 33: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/33.jpg)
Maxwell’s Equations Discretization
Yee Scheme in One Space Dimension
Hz |n+ 1
2
r+ 12
− Hz |n− 1
2
r+ 12
∆t= − 1
µ
Ey |nr+1 − Ey |nr∆x
Ey |n+1r − Ey |nr
∆t= −1
ε
Hz |n+ 1
2
r+ 12
− Hz |n+ 1
2
r− 12
∆x
This method is an explicit second order scheme in both space andtime.
It is conditionally stable with the CFL condition
ν =c∆t
∆x≤ 1
where ν is called the Courant number and c = 1/√
εµ.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 17 / 56
![Page 34: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/34.jpg)
Maxwell’s Equations Discretization
Numerical Stability: A Square Wave
Case c∆t = ∆x
−1 −0.5 0 0.5 1
0
0.5
1
x
E
t=0 t=100 ∆ t t=200 ∆ t
Case c∆t > ∆x
−1 −0.5 0 0.5 1−2
−1
0
1
2
3
x
E
t =0
t =18 ∆ t
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 18 / 56
![Page 35: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/35.jpg)
Maxwell’s Equations Discretization
Numerical Dispersion: A Square Wave
Case c∆t = ∆x
−1 −0.5 0 0.5 1
0
0.5
1
x
E
t=0 t=100 ∆ t t=200 ∆ t
Case c∆t < ∆x
−1 −0.5 0 0.5 1
0
0.5
1
x
E
t=0 t=100 ∆ t
t=200 ∆ t
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 19 / 56
![Page 36: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/36.jpg)
Polarization
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 20 / 56
![Page 37: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/37.jpg)
Polarization Description
Dispersive Dielectrics
RecallD = εE + P
where P is the dielectric polarization.
Debye modelτ P + P = ε0(εs − ε∞)E
where q = {ε∞, εs , τ} and, in particular, τ is called the relaxationtime.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 21 / 56
![Page 38: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/38.jpg)
Polarization Description
Frequency Domain
Converting to frequency domain via Fourier transforms
D = εE + P
becomesD = ε(ω)E
where ε(ω) is called the complex permittivity.
Debye model gives
ε(ω) = ε∞ +εs − ε∞1 + iωτ
Cole-Cole model (heuristic generalization)
ε(ω) = ε∞ +εs − ε∞
1 + (iωτ)1−α
Unfortunately, the Cole-Cole model corresponds to a fractional orderdifferential equation in the time domain, and simulation is notstraight-forward.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 22 / 56
![Page 39: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/39.jpg)
Polarization Dry Skin Data
102
104
106
108
1010
101
102
103
f (Hz)
ε
True DataDebye ModelCole−Cole Model
Figure: Real part of ε(ω), ε, or the permittivity.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 23 / 56
![Page 40: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/40.jpg)
Polarization Dry Skin Data
102
104
106
108
1010
10−4
10−3
10−2
10−1
100
101
f (Hz)
σ
True DataDebye ModelCole−Cole Model
Figure: Imaginary part of ε(ω), σ, or the conductivity.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 24 / 56
![Page 41: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/41.jpg)
Polarization Motivation
Motivation
The Cole-Cole model corresponds to a fractional order ODE in thetime-domain and is difficult to simulate.
Debye is efficient to simulate, but does not represent permittivity well.
Better fits to data are obtained by taking linear combinations ofDebye models (multi-pole Debye), idea comes from the knownexistence of multiple physical mechanisms.
An alternative approach is to consider the Debye model but with a(continuous) distribution of relaxation times.
Empirical measurements suggest a log-normal distribution.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 25 / 56
![Page 42: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/42.jpg)
Polarization Fit to Dry Skin Data
102
104
106
108
1010
102
103
f (Hz)
ε
DataDebye (27.79)Cole−Cole (10.4)Model A (13.60)Model B (12.19)
Figure: Real part of ε(ω), called simply ε, or the permittivity. Model A refers tothe Debye model with a uniform distribution on τ .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 26 / 56
![Page 43: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/43.jpg)
Polarization Random Polarization
Random Polarization
We define the random polarization P(x , t; τ) to be the solution to
τ P + P = ε0(εs − ε∞)E
where τ is a random variable with PDF f (τ), for example,
f (τ) =1
τb − τa
for a uniform distribution.
The electric field depends on the macroscopic polarization, which we taketo be the expected value of the random polarization at each point (x , t)
P(x , t;F ) =
∫ τb
τa
P(x , t; τ)f (τ)dτ.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 27 / 56
![Page 44: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/44.jpg)
Polarization Random Polarization
Random Polarization
We define the random polarization P(x , t; τ) to be the solution to
τ P + P = ε0(εs − ε∞)E
where τ is a random variable with PDF f (τ), for example,
f (τ) =1
τb − τa
for a uniform distribution.The electric field depends on the macroscopic polarization, which we taketo be the expected value of the random polarization at each point (x , t)
P(x , t;F ) =
∫ τb
τa
P(x , t; τ)f (τ)dτ.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 27 / 56
![Page 45: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/45.jpg)
Polarization Random Polarization
Numerical Approximation of Random Polarization
Recall, to solve the inverse problem for the distribution of relaxation times,we need a method of accurately and efficiently simulating P(x , t;F ).
Could apply a quadrature rule to the integral in the expected value.Results in a linear combination of individual Debye solves.
Alternatively, we can use a method which separates the timederivative from the randomness and applies a truncated expansion inrandom space, called Polynomial Chaos. Results in a linear system.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 28 / 56
![Page 46: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/46.jpg)
Polarization Random Polarization
Numerical Approximation of Random Polarization
Recall, to solve the inverse problem for the distribution of relaxation times,we need a method of accurately and efficiently simulating P(x , t;F ).
Could apply a quadrature rule to the integral in the expected value.Results in a linear combination of individual Debye solves.
Alternatively, we can use a method which separates the timederivative from the randomness and applies a truncated expansion inrandom space, called Polynomial Chaos. Results in a linear system.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 28 / 56
![Page 47: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/47.jpg)
Polarization Random Polarization
Numerical Approximation of Random Polarization
Recall, to solve the inverse problem for the distribution of relaxation times,we need a method of accurately and efficiently simulating P(x , t;F ).
Could apply a quadrature rule to the integral in the expected value.Results in a linear combination of individual Debye solves.
Alternatively, we can use a method which separates the timederivative from the randomness and applies a truncated expansion inrandom space, called Polynomial Chaos. Results in a linear system.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 28 / 56
![Page 48: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/48.jpg)
Polarization Polynomial Chaos
Polynomial Chaos: Simple example
Consider the first order, constant coefficient, linear ODE
y = −ky , k = k(ξ) = ξ, ξ ∼ N (0, 1).
We apply a Polynomial Chaos expansion in terms of orthogonal Hermitepolynomials Hj to the solution y :
y(t, ξ) =∞∑j=0
αj(t)φj(ξ), φj(ξ) = Hj(ξ)
then the ODE becomes
∞∑j=0
αj(t)φj(ξ) = −∞∑j=0
αj(t)ξφj(ξ),
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 29 / 56
![Page 49: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/49.jpg)
Polarization Polynomial Chaos
Triple recursion formula
∞∑j=0
αj(t)φj(ξ) = −∞∑j=0
αj(t)ξφj(ξ),
We can eliminate the explicit dependence on ξ by using the triple recursionformula for Hermite polynomials
ξHj = jHj−1 + Hj+1.
Thus∞∑j=0
αj(t)φj + αj(t)(jφj−1 + φj+1) = 0.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 30 / 56
![Page 50: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/50.jpg)
Polarization Polynomial Chaos
Galerkin Projection onto span({φi}pi=0)
Taking the weighted inner product with each basis gives
∞∑j=0
αj(t)〈φj , φi 〉W + αj(t)(j〈φj−1, φi 〉W + 〈φj+1, φi 〉W ) = 0,
i = 0, . . . , p.
Where
〈f (ξ), g(ξ)〉W =
∫f (ξ)g(ξ)W (ξ)dξ.
Using orthogonality, 〈φj , φi 〉W = 〈φi , φi 〉W δij , we have
αi 〈φi , φi 〉W + (i + 1)αi+1〈φi , φi 〉W + αi−1〈φi , φi 〉W = 0, i = 0, . . . , p,
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 31 / 56
![Page 51: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/51.jpg)
Polarization Polynomial Chaos
Galerkin Projection onto span({φi}pi=0)
Taking the weighted inner product with each basis gives
∞∑j=0
αj(t)〈φj , φi 〉W + αj(t)(j〈φj−1, φi 〉W + 〈φj+1, φi 〉W ) = 0,
i = 0, . . . , p.
Where
〈f (ξ), g(ξ)〉W =
∫f (ξ)g(ξ)W (ξ)dξ.
Using orthogonality, 〈φj , φi 〉W = 〈φi , φi 〉W δij , we have
αi 〈φi , φi 〉W + (i + 1)αi+1〈φi , φi 〉W + αi−1〈φi , φi 〉W = 0, i = 0, . . . , p,
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 31 / 56
![Page 52: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/52.jpg)
Polarization Polynomial Chaos
Deterministic ODE system
Letting ~α represent the vector containing α0(t), . . . , αp(t) (and assumingαp+1(t), etc. are identically zero) the system of ODEs can be written
~α + M~α = ~0,
with
M =
0 11 0 2
. . .. . .
. . .. . .
. . . p1 0
The mean value of y(t, ξ) is α0(t).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 32 / 56
![Page 53: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/53.jpg)
Polarization Polynomial Chaos
Generalizations
For any choice of family of orthogonal polynomials, there exists a triplerecursion formula. Given the arbitrary relation
ξφj = ajφj−1 + bjφj + cjφj+1
(with φ−1 = 0) then the matrix above becomes
M =
b0 a1
c0 b1 a2
. . .. . .
. . .. . .
. . . ap
cp−1 bp
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 33 / 56
![Page 54: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/54.jpg)
Polarization Polynomial Chaos
Generalizations
Consider the non-homogeneous ODE
y + ky = g(t), k = k(ξ) = σξ + µ, ξ ∼ N (0, 1).
then
αi + σ [(i + 1)αi+1 + αi−1] + µαi = g(t)δ0i , i = 0, . . . , p,
or the deterministic ODE system
~α + (σM + µI )~α = g(t)~e1.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 34 / 56
![Page 55: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/55.jpg)
Polarization Polynomial Chaos
Exponential convergence
Any set of orthogonal polynomials can be used in the truncatedexpansion, but there may be an optimal choice.
If the polynomials are orthogonal with respect to weighting functionf (ξ), and k has PDF f (k), then it is known that the PC solutionconverges exponentially in terms of p.
In practice, approximately 4 are generally sufficient.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 35 / 56
![Page 56: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/56.jpg)
Polarization Polynomial Chaos
Figure: Solution of each mode with Gaussian random coefficient by fourth-orderHermitian-chaos.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 36 / 56
![Page 57: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/57.jpg)
Polarization Polynomial Chaos
Figure: Convergence of error with Gaussian random coefficient by fourth-orderHermitian-chaos.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 37 / 56
![Page 58: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/58.jpg)
Polarization Polynomial Chaos
Generalized Polynomial Chaos
Table: Popular distributions and corresponding orthogonal polynomials.
Distribution Polynomial Support
Gaussian Hermite (−∞,∞)gamma Laguerre [0,∞)beta Jacobi [a, b]
uniform Legendre [a, b]
Note: lognormal random variables may be handled as a non-linear function(e.g., Taylor expansion) of a normal random variable.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 38 / 56
![Page 59: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/59.jpg)
Polarization Random Polarization
Random Polarization
We can apply Polynomial Chaos method to our random polarization
τ P + P = ε0(εs − ε∞)E , τ = τ(ξ) = rξ + r
resulting in(rM + mI )~α + ~α = ε0(εs − ε∞)E ~e1 =: ~g
orA~α + ~α = ~g .
The macroscopic polarization, the expected value of the randompolarization at each point (t, x), is simply
P(t, x ;F ) = α0(t, x).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 39 / 56
![Page 60: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/60.jpg)
Polarization Random Polarization
Random Polarization
We can apply Polynomial Chaos method to our random polarization
τ P + P = ε0(εs − ε∞)E , τ = τ(ξ) = rξ + r
resulting in(rM + mI )~α + ~α = ε0(εs − ε∞)E ~e1 =: ~g
orA~α + ~α = ~g .
The macroscopic polarization, the expected value of the randompolarization at each point (t, x), is simply
P(t, x ;F ) = α0(t, x).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 39 / 56
![Page 61: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/61.jpg)
Polarization Discretization
Applying the central difference approximation, based on the Yee scheme,Maxwell’s equations with conductivity and polarization included
ε∂E
∂t= −∂H
∂z− σE − ∂P
∂t
and
µ∂H
∂t= −∂E
∂z
become
En+ 1
2k − E
n− 12
k
∆t= −1
ε
Hnk+ 1
2
− Hnk− 1
2
∆z− σ
ε
En+ 1
2k + E
n− 12
k
2− 1
ε
Pn+ 1
2k − P
n− 12
k
∆t
andHn+1
k+ 12
− Hnk+ 1
2
∆t= − 1
µ
En+ 1
2k+1 − E
n+ 12
k
∆z.
Note that while the electric field and magnetic field are staggered in time,the polarization updates simultaneously with the electric field.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 40 / 56
![Page 62: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/62.jpg)
Polarization Discretization
Need a similar approach for discretizing the PC system
A~α + ~α = ~g .
Applying second order central differences, as before, to ~α = ~α(zk):
A~αn+ 1
2 − ~αn− 12
∆t+
~αn+ 12 + ~αn− 1
2
2=
~gn+ 12 + ~gn− 1
2
2.
Combining like terms gives
(2A + ∆tI )~αn+ 12 = (2A−∆tI )~αn− 1
2 + ∆t(~gn+ 1
2 + ~gn− 12
)Note that we first solve the discrete electric field equation for E
n+ 12
k and
plug in here (in ~gn+ 12 ) to update ~α.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 41 / 56
![Page 63: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/63.jpg)
Polarization Discretization
Comments on Polynomial Chaos
Gives a simple and efficient method to simulate systems involvingdistributions of parameters.
Works equally well in three spatial dimensions.
Limitation: choice of polynomials depends on type of distribution.
Need error estimates to be sure that a sufficient number ofpolynomials is used in the expansion.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 42 / 56
![Page 64: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/64.jpg)
Inverse Problem for Distribution
Outline
1 Inverse ProblemsPreliminariesDistributions
2 Maxwell’s EquationsDescriptionSimplificationsDiscretization
3 PolarizationDescriptionRandom PolarizationPolynomial Chaos
4 Inverse Problem for DistributionDiscrete Distribution ExampleContinuous Distribution Examples
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 43 / 56
![Page 65: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/65.jpg)
Inverse Problem for Distribution
Inverse Problem for RTD
Now that we have a numerical method for simulating Maxwell’s equationswith random polarization
P(x , t;F ) =
∫ τb
τa
P(x , t; τ)dF (τ)
we address the inverse problem for the relaxation time distribution F.
Given data {E}j we seek to determine a probability distribution F ∗,such that
F ∗ = minF∈P(Q)
J (F ),
where
J (F ) =∑
j
k(E (tj ;F )− Ej
)2.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 44 / 56
![Page 66: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/66.jpg)
Inverse Problem for Distribution Discrete Distribution Example
Discrete Distribution Example
Mixture of two Debye materials with τ1 and τ2
Total polarization a weighted average
P = α1P1(τ1) + α2P2(τ2)
Corresponds to the discrete probability distribution
dF (τ) = [α1δ(τ1) + α2δ(τ2)] dτ
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 45 / 56
![Page 67: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/67.jpg)
Inverse Problem for Distribution Discrete Distribution Example
Discrete Distribution Inverse Problem
Assume the proportions α1 and α2 = 1− α1 are known.
Define the following least squares optimization problem:
min(τ1,τ2)
J = min(τ1,τ2)
∑j
∣∣∣E (tj , 0; (τ1, τ2))− Ej
∣∣∣2 ,
where Ej is synthetic data generated using (τ∗1 , τ∗2 ) in our simulationroutine.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 46 / 56
![Page 68: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/68.jpg)
Inverse Problem for Distribution Discrete Distribution Example
Discrete Distribution J using 106Hz
−8−7.8
−7.6−7.4
−7.2
−8
−7.8
−7.6
−7.4
−7.2
−7
−6
−5
−4
−3
−2
−1
log(tau1)
f=1e6,α1=.5
log(tau2)
log(
J)
The solid line above the surface represents the curve of constantτ := α1τ1 + (1− α1)τ2. Note: ωτ ≈ .15 < 1.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 47 / 56
![Page 69: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/69.jpg)
Inverse Problem for Distribution Discrete Distribution Example
Inverse Problem Results 106Hz
τ1 τ2 τ
Initial 3.95000e-8 1.26400e-8 2.60700e-8LM 3.19001e-8 1.55032e-8 2.37016e-8Final 3.16039e-8 1.55744e-8 2.37016e-8Exact 3.16000e-8 1.58000e-8 2.37000e-8
Levenberg-Marquardt converges to curve of constant τ
Traversing curve results in accurate final estimates
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 48 / 56
![Page 70: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/70.jpg)
Inverse Problem for Distribution Discrete Distribution Example
Discrete Distribution J using 1011Hz
−8−7.9
−7.8−7.7
−7.6−7.5
−7.4−7.3
−7.2−7.1
−8
−7.8
−7.6
−7.4
−7.2
−8
−6
−4
−2
log(tau1)
f=1e11,α1=.5
log(tau2)
log(
J)
The solid line above the surface represents the curve of constantλ := 1
c τ = α1cτ1
+ α2cτ2
. Note: ωτ ≈ 15000 > 1.
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 49 / 56
![Page 71: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/71.jpg)
Inverse Problem for Distribution Discrete Distribution Example
Inverse Problem Results 1011Hz
τ1 τ2 λ
Initial 3.95000e-8 1.26400e-8 0.174167LM 4.08413e-8 1.41942e-8 0.158333Final 3.16038e-8 1.57991e-8 0.158333Exact 3.16000e-8 1.58000e-8 0.158333
Levenberg-Marquardt converges to curve of constant λ
Traversing curve results in accurate final estimates
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 50 / 56
![Page 72: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/72.jpg)
Inverse Problem for Distribution Continuous Distribution Examples
Log-Normal Distribution of τ
Gaussian distribution of log(τ) with mean µ and with standard deviation σ:
dF (τ ;µ, σ) =1√
2πσ2
1
ln 10
1
τexp
(− (log τ − µ)2
2σ2
)dτ,
Corresponding inverse problem:
minq=(µ,σ)
∑j
∣∣∣E (tj , 0; (µ, σ))− Ej
∣∣∣2 .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 51 / 56
![Page 73: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/73.jpg)
Inverse Problem for Distribution Continuous Distribution Examples
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2
x 10−7
0
2
4
6
8
10
12
τ
f
Estimated density of τ as log normal
Initial estimate (*) Converged estimate (+)and true estimate (o)
Shown are the initial density function, the minimizing density function andthe true density function (the latter two being practically identical).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 52 / 56
![Page 74: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/74.jpg)
Inverse Problem for Distribution Continuous Distribution Examples
Bi-Gaussian Distribution of log τ
Bi-Gaussian distribution with means µ1 and µ2 and with standard deviationsσ1 and σ2:
dF (τ) = α1dF (τ ;µ1, σ1) + (1− α1)dF (τ ;µ2, σ2),
where
dF (τ ;µ, σ) =1√
2πσ2
1
ln 10
1
τexp
(− (log τ − µ)2
2σ2
)dτ,
Corresponding inverse problem:
minq=(µ1,σ1,µ2,σ2)
∑j
∣∣∣|E (tj , 0; q)| − |Ej |∣∣∣2 .
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 53 / 56
![Page 75: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/75.jpg)
Inverse Problem for Distribution Continuous Distribution Examples
Bi-Gaussian Results with 106Hz
case µ1 σ1 µ2 σ2 τInitial 1.58001e-7 0.036606 3.16002e-9 0.0571969 8.1201e-8µ1,µ2 4.27129e-8 0.036606 4.24844e-9 0.0571969 2.36499e-8Final 3.09079e-8 0.0136811 1.63897e-8 0.0663628 2.37978e-8Exact 3.16000e-8 0.0457575 1.58000e-8 0.0457575 2.37957e-8
Levenberg-Marquardt converges to curve of constant τ
Traversing curve results in reasonable final estimates for µk but worsefor σk .
Note: for this continuous distribution,
τ =
∫T
τdF (τ).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 54 / 56
![Page 76: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/76.jpg)
Inverse Problem for Distribution Continuous Distribution Examples
Bi-Gaussian Results with 1011Hz
case µ1 σ1 µ2 σ2 λInitial 1.58001e-7 0.036606 3.16002e-9 0.0571969 0.538786µ1,µ2 1.58001e-7 0.036606 1.12595e-8 0.0571969 0.158863Final 3.23914e-8 0.0366059 1.56020e-8 0.0571968 0.158863Exact 3.16000e-8 0.0457575 1.58000e-8 0.0457575 0.158863
Levenberg-Marquardt converges to curve of constant λ
Traversing curve results in reasonable final estimates for µk but nochange in σk .
Note: for this continuous distribution,
λ =
∫T
1
cτdF (τ).
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 55 / 56
![Page 77: Inverse Problems for Distributions of Parameters in PDE ...sites.science.oregonstate.edu/~gibsonn/Reed2010.pdfNov 4, 2010 Prof. Gibson (OSU) Inverse Problems for Distributions Reed](https://reader035.vdocuments.us/reader035/viewer/2022071422/611bf2119cbb1c30155a562c/html5/thumbnails/77.jpg)
Conclusions
Comments on Time-domain Inverse Problems
Our estimation methods worked well for discrete distributions
Our estimation methods worked well for the continuous uniformdistribution and Gaussian distributions
We are currently only able to determine the means in the bi-Gaussiandistributions, this data is relatively insensitive to the standarddeviations
Prof. Gibson (OSU) Inverse Problems for Distributions Reed 2010 56 / 56