cfcs - expectation and variance; chebyshev's …expectation and related concepts chebyshev’s...
TRANSCRIPT
![Page 1: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/1.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
CFCS
Expectation and Variance; Chebyshev’s Theorem
Miles Osborne (originally: Frank Keller)
School of InformaticsUniversity of [email protected]
February 8, 2008
Miles Osborne (originally: Frank Keller) CFCS 1
![Page 2: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/2.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
1 Expectation and Related ConceptsExpectationMeanVariance
2 Chebyshev’s Theorem
Miles Osborne (originally: Frank Keller) CFCS 2
![Page 3: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/3.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Expectation
Much of probability theory comes from gambling. If we bought alottery ticket, how much would we expect to win on average?
Example
In a raffle, there are 10,000 tickets. The probability of winning istherefore 1
10,000 for each ticket. The prize is worth $4,800. Hence
the expectation per ticket is $4,80010,000
= $0.48.
In this example, the expectation can be thought of as the averagewin per ticket.
Miles Osborne (originally: Frank Keller) CFCS 3
![Page 4: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/4.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Expectation
This intuition can be formalized as the expected value of a randomvariable:
Definition: Expected Value
If X is a discrete random variable and f (x) is the value of itsprobability distribution at x , then the expected value of X is:
E (X ) =∑
x
x · f (x)
We will only deal with the discrete case here (but the definitioncan be extended to cover continuous random variables).
Miles Osborne (originally: Frank Keller) CFCS 4
![Page 5: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/5.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Expectation
Example
A balanced coin is flipped three times. Let X be the number ofheads. Then the probability distribution of X is:
f (x) =
18 for x = 038
for x = 138 for x = 218 for x = 3
The expected value of X is:
E (X ) =∑
x
x · f (x) = 0 ·1
8+ 1 ·
3
8+ 2 ·
3
8+ 3 ·
1
8=
3
2
Miles Osborne (originally: Frank Keller) CFCS 5
![Page 6: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/6.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Expectation
The notion of expectation can be generalized to cases in which afunction g(X ) is applied to a random variable X .
Theorem: Expected Value of a Function
If X is a discrete random variable and f (x) is the value of itsprobability distribution at x , then the expected value of g(X ) is:
E [g(X )] =∑
x
g(x)f (x)
Miles Osborne (originally: Frank Keller) CFCS 6
![Page 7: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/7.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Expectation
Example
Let X be the number of points rolled with a balanced die. Find theexpected value of X and of g(X ) = 2X 2 + 1.
The probability distribution for X is f (x) = 16 . Therefore:
E (X ) =∑
x
x · f (x) =6
∑
x=1
x ·1
6=
21
6
E [g(X )] =∑
x
g(x)f (x) =
6∑
x=1
(2x2 + 1)1
6=
94
6
Miles Osborne (originally: Frank Keller) CFCS 7
![Page 8: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/8.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Mean
The expectation of a random variable is also called the mean ofthe random variable. It’s denoted by µ.
Definition: Mean
If X is a discrete random variable and f (x) is the value of itsprobability distribution at x , then the mean of X is:
µ = E (X ) =∑
x
x · f (x)
Intuitively, µ denotes the average value of X .
Miles Osborne (originally: Frank Keller) CFCS 8
![Page 9: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/9.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Mean
Histogram with mean for the distribution in the previous example(number of heads in three coin flips):
0 1 2 3x
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
f(x)
E(X) = µ
Miles Osborne (originally: Frank Keller) CFCS 9
![Page 10: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/10.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Variance
Definition: Variance
If X is a discrete random variable and f (x) is the value of itsprobability distribution at x , and µ is its mean then:
σ2 = var(X ) = E [(X − µ)2] =
∑
x
(x − µ)2f (x)
is the variance of X .
Intuitively, var(X ) reflects the spread or dispersion of adistribution, i.e., how much it diverges from the mean.
σ is called the standard deviation of X .
Miles Osborne (originally: Frank Keller) CFCS 10
![Page 11: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/11.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Variance
Example
Let X be a discrete random variable with the distribution:
f (x) =
18
for x = 038
for x = 138
for x = 218
for x = 3
Then the variance and standard deviation of X are:
var(X ) =∑
x
(x − µ)2f (x)
= (0 −3
2)2 ·
1
8+ (1 −
3
2)2 ·
3
8+ (2 −
3
2)2 ·
3
8+ (3 −
3
2)2 ·
1
8= 0.86
σ =√
var(X ) = 0.93
Miles Osborne (originally: Frank Keller) CFCS 11
![Page 12: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/12.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Variance
Histogram with mean and standard deviation for the previousexample:
0 1 2 3x
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
f(x)
µσ σ
Miles Osborne (originally: Frank Keller) CFCS 12
![Page 13: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/13.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Dispersion
σ2 as a measure of dispersion:
1 2 3 4 5 6 7 8 9x
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
f(x)
µ = 5 and σ2 = 5.26
1 2 3 4 5 6 7 8 9x
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
f(x)
µ = 5 and σ2 = 3.18
Miles Osborne (originally: Frank Keller) CFCS 13
![Page 14: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/14.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
ExpectationMeanVariance
Dispersion
σ2 as a measure of dispersion:
1 2 3 4 5 6 7 8 9x
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
f(x)
µ = 5 and σ2 = 1.66
1 2 3 4 5 6 7 8 9x
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
f(x)
µ = 5 and σ2 = 0.88
Miles Osborne (originally: Frank Keller) CFCS 14
![Page 15: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/15.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
Chebyshev’s Theorem
Chebyshev’s Theorem
If µ and σ are the mean and the standard deviation of a randomvariable X , and σ 6= 0, then for any positive constant k:
P(|x − µ| < kσ) ≥ 1 −1
k2
In other words, the probability that X will take on a value within k
standard deviations of the mean is at least 1 − 1k2 .
Example
Assume k = 2. Then P(|x − µ| < 2σ) = 1 − 122 = 3
4 , i.e., at least75% of the values of X fall within 2 standard deviations of themean.
Miles Osborne (originally: Frank Keller) CFCS 15
![Page 16: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/16.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
Chebyshev’s Theorem
Example: distribution with µ = 4.99 and σ = 3.13.
Miles Osborne (originally: Frank Keller) CFCS 16
![Page 17: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/17.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
Chebyshev’s Theorem
Example
Using Chebyshev’s Theorem, we can show: if X is normallydistributed, then:
P(|x − µ| < 2σ) = .9544
In other words, the 95.44% of all values of X fall within 2 standarddeviations of the mean. This is a tighter than the bound of 75%that holds for an arbitrary distribution.
Many cognitive variables (e.g., IQ measurements) are normallydistributed. More on this in the next lecture.
Miles Osborne (originally: Frank Keller) CFCS 17
![Page 18: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/18.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
Chebyshev’s Theorem
Example: normal distribution with µ = 0 and σ = 1.
Miles Osborne (originally: Frank Keller) CFCS 18
![Page 19: CFCS - Expectation and Variance; Chebyshev's …Expectation and Related Concepts Chebyshev’s Theorem Expectation Mean Variance Expectation Much of probability theory comes from gambling](https://reader033.vdocuments.us/reader033/viewer/2022042101/5e7e12ea30b0357d1e410ca3/html5/thumbnails/19.jpg)
Expectation and Related ConceptsChebyshev’s Theorem
Summary
The expected value of a random variable is its average valueover a distribution;
the mean is the same as the expected value;
the variance of random variable indicates its dispersion, orspread around the mean;
Chebyshev’s theorem places a bound on the probability thatthe values of a distribution will be within a certain intervalaround the mean;
for example, at least 75% of all values of a distribution fallwithin two standard deviations of the mean.
Miles Osborne (originally: Frank Keller) CFCS 19