lecture 6: rayleigh, rice and lognormal distributions transform...
TRANSCRIPT
![Page 1: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/1.jpg)
Lecture 6:Rayleigh, Rice and Lognormal Distributions
Transform Methods and the Central Limit Theorem
Department of Electrical EngineeringPrinceton UniversitySeptember 30, 2013
ELE 525: Random Processes in Information Systems
Hisashi Kobayashi
Textbook: Hisashi Kobayashi, Brian L. Mark and William Turin, Probability, Random Processes and Statistical Analysis (Cambridge University Press, 2012)
9/30/2013 1Copyright Hisashi Kobayashi 2013
![Page 2: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/2.jpg)
Propagation in a radio channel
Let L (>1) be the loss or attenuation factor. Divide the path between the transmitter and receiver into contiguous and
disjoint segments. The overall loss L is the product of the loss within each segment:
where we set
From the central limit theorem (CLT), we see that Y is asymptotically normally distributed.
Therefore, the overall attenuation factor is log-normally distributed.
9/30/2013 Copyright Hisashi Kobayashi 2013 2
![Page 3: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/3.jpg)
decibel (dB) representation
9/30/2013 Copyright Hisashi Kobayashi 2013 3
![Page 4: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/4.jpg)
7.5 Rayleigh and Rice distributions 7.5.1 Rayleigh distribution
Let X and Y be independent RVs with N(0, σ2). We define
Then its PDF is
called the Rayleigh distribution.
Derivation of (7.60):Writing X=σ U1 and Y=σ U2, where U1 and U2 are from N(0, 1) , we see
By setting n=2 in (7.2) we find
9/30/2013 Copyright Hisashi Kobayashi 2013 4
![Page 5: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/5.jpg)
Set
Alternative derivation of (7.60):
Hence, we obtain (7.60) and
9/30/2013 Copyright Hisashi Kobayashi 2013 5
![Page 6: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/6.jpg)
7.5.2 Rice distribution
Assume X is from N(μX, σ2) and Y is from N(μY, σ2) . Then the PDF of R of (7.59) is
which is Rice distribution or Rician distribution.Stephen O. Rice (1907-1986)
where
which is the modified Bessel function of the first kind and zeroth order.
See Eqs. (7.78), (7.79) and (7.80) of pp. 170-171 to derive (7.75)
9/30/2013 Copyright Hisashi Kobayashi 2013 6
(Note: a typo in (7.75) of the book)
![Page 7: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/7.jpg)
The normalized Rice distribution Let the amplitude R be normalized by σ, i.e.,
V = R/σand let
m= μ/σ
9/30/2013 Copyright Hisashi Kobayashi 2013 7
![Page 8: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/8.jpg)
The modified Bessel function of the first kind and zeroth order
Apply the Taylor series expansion to In (7.77) and noting I0(x) is an
even function,
http://mathworld.wolfram.com/ModifiedBesselFunctionoftheFirstKind.html
Note: For the modified Bessel function of the first kind and nth order, see
9/30/2013 Copyright Hisashi Kobayashi 2013 8
![Page 9: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/9.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 9
![Page 10: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/10.jpg)
8 Moment-generating functionand characteristic function
8.1 Moment-generating function (MGF) 8.1.1 Moment-generating function of one random variable
The moment-generating function (MGF) of a RV X is defined by
9/30/2013 Copyright Hisashi Kobayashi 2013 10
![Page 11: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/11.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 11
is called the logarithmic MGF (log-MGF) or the cumulant MGF.
The natural logarithm of the MGF
![Page 12: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/12.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 12
![Page 13: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/13.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 13
![Page 14: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/14.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 14
![Page 15: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/15.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 15
The nth central moment
![Page 16: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/16.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 16
8.1.2 Moment-generating function of sum of independent random variables
Let Y = X1 + X2, where X1 and X2 are independent. Then the MGF of Y is
Define Y as their sum.
Then the MGF of Y is
![Page 17: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/17.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 17
8.1.3 Joint moment-generating function of multivariate random variables
The joint MGF
![Page 18: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/18.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 18
where
Writing
From the definition of the joint MGF
Thus, we find the joint MGF:
![Page 19: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/19.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 19
Generalization to a multivariate normal distribution
![Page 20: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/20.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 20
For a continuous RV
For a discrete RV
![Page 21: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/21.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 21
![Page 22: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/22.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 22
The function is analytic (i.e., possessing no poles), the integral around the contour of Figure (a) is zero – the Cauchy-Goursat integral theorem.
The second term is so must be the second term. Hence from (8.64)
For the case u < 0, the contour integral in Figure (b) will lead to the same result(Problem 8.14).
![Page 23: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/23.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 23
By applying the transformation Y=(X-μ)/σ , we find the CF of N(μ, σ2)
The cumulative generating function (CGF)
![Page 24: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/24.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 24
8.2.2 Sum of independent random variables and convolution
Y= X1 + X2
The above is called the convolution integral (or simply convolution) of
![Page 25: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/25.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 25
This reproductive property of normal variables holds for the sum of any number of independent normal variables
8.2.3 Moment generation from characteristic function
![Page 26: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/26.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 26
Assuming that the Taylor-series expansion of the CF exists throughout some interval in u that includes the origin,
Using (8.81),
The cumulant generating function (CGN) defined in (8.69)
may also be expanded:
![Page 27: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/27.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 27
8.2.4 Joint characteristic function of multivariate random variables
We define the joint CF as
The joint moment, if it exists, can be obtained by
The inverse transform (8.59) can be extended to the multivariate case.
![Page 28: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/28.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 28
But
Thus,
The formula (8.96) holds for the multivariate normal variables as well (Table 8.2).
![Page 29: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/29.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 29
Let {Xi ; 1 ≤ i ≤ n} be n independent samples from a population with an arbitrary Distribution function F(x), but with finite mean μ and variance σ2.
![Page 30: Lecture 6: Rayleigh, Rice and Lognormal Distributions Transform …hp.hisashikobayashi.com/wp-content/uploads/2013/12/ELE... · 2013-12-20 · Rayleigh, Rice and Lognormal Distributions](https://reader033.vdocuments.us/reader033/viewer/2022041911/5e678a2fa08c6f1df65ca3cf/html5/thumbnails/30.jpg)
9/30/2013 Copyright Hisashi Kobayashi 2013 30
By applying the Taylor series expansion (see (8.83))
Thus,
Thus, the distribution function of the RV converges to that of the distribution N(0, 1):
Thus, is asymptotically normally distributed according to