expected values, covariance and correlation

234
logo1 Expected Values Covariance Examples Correlation Coefficient Expected Values, Covariance and Correlation Bernd Schr ¨ oder Bernd Schr¨ oder Louisiana Tech University, College of Engineering and Science Expected Values, Covariance and Correlation

Upload: others

Post on 22-Feb-2022

15 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Expected Values, Covariance andCorrelation

Bernd Schroder

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 2: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition.

If X and Y are jointly distributed random variables,then the expected value of h(X,Y) is

E(h(X,Y)

)={

∑x ∑y h(x,y)p(x,y) if X,Y are discrete,∫∞

−∞

∫∞

−∞h(x,y)f (x,y) dx dy if X,Y are continuous.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 3: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. If X and Y are jointly distributed random variables,then the expected value of h(X,Y) is

E(h(X,Y)

)={

∑x ∑y h(x,y)p(x,y) if X,Y are discrete,∫∞

−∞

∫∞

−∞h(x,y)f (x,y) dx dy if X,Y are continuous.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 4: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. If X and Y are jointly distributed random variables,then the expected value of h(X,Y) is

E(h(X,Y)

)={

∑x ∑y h(x,y)p(x,y) if X,Y are discrete,∫∞

−∞

∫∞

−∞h(x,y)f (x,y) dx dy if X,Y are continuous.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 5: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. To generate energy, a certain house has solar panelsand a wind turbine. Let X be the percentage of time that thesolar panels generate electricity and let Y be the percentage oftime that the wind turbine generates electricity. Assume that thejoint probability density function of X and Y is

p(x,y) =83

(12− x+ y

)for 0≤ x≤ 0.5 and 0≤ y≤ 1.

Compute E(X), E(Y) and E(XY).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 6: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. To generate energy, a certain house has solar panelsand a wind turbine. Let X be the percentage of time that thesolar panels generate electricity and let Y be the percentage oftime that the wind turbine generates electricity. Assume that thejoint probability density function of X and Y is

p(x,y) =83

(12− x+ y

)for 0≤ x≤ 0.5 and 0≤ y≤ 1.

Compute E(X), E(Y) and E(XY).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 7: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X)

=∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 8: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0

x83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 9: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 10: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 11: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 12: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx

=83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 13: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 14: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0

=83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 15: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]

=83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 16: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12

=29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 17: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 18: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 19: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X)

=∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 20: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx

=83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 21: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx

= · · · = 29

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 22: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · ·

=29

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 23: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(X) =∫ 0.5

0

∫ 1

0x

83

(12− x+ y

)dy dx =

83

∫ 0.5

0

∫ 1

0

12

x− x2 + xy dy dx

=83

∫ 0.5

0

12

xy− x2y+12

xy2∣∣∣∣10

dx =83

∫ 0.5

0x− x2 dx

=83

[12

x2− 13

x3]0.5

0=

83

[18− 1

24

]=

83· 1

12=

29

Compare with the result using marginal distributions:

E(X) =∫ 0.5

0x

83

[1− x] dx =83

∫ 0.5

0x− x2 dx = · · · = 2

9

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 24: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y)

=∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 25: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0

y83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 26: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 27: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 28: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 29: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 30: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 31: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx

=83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 32: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 33: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]

=83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 34: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]

=83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 35: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48

=1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 36: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(Y) =∫ 0.5

0

∫ 1

0y

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

y− xy+ y2 dy dx

=83

∫ 0.5

0

14

y2− 12

xy2 +13

y3∣∣∣∣10

dx

=83

∫ 0.5

0

14− 1

2x+

13

dx

=83

∫ 0.5

0

712− 1

2x dx =

83

[7

12x− 1

4x2]0.5

0

=83

[7

24− 1

16

]=

83

[1448− 3

48

]=

83· 11

48=

1118

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 37: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY)

=∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 38: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0

xy83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 39: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 40: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 41: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 42: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 43: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 44: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 45: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]

=83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 46: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96

=5

36

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 47: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

E(XY) =∫ 0.5

0

∫ 1

0xy

83

(12− x+ y

)dy dx

=83

∫ 0.5

0

∫ 1

0

12

xy− x2y+ xy2 dy dx

=83

∫ 0.5

0

14

xy2− 12

x2y2 +13

xy3∣∣∣∣10

dx

=83

∫ 0.5

0

712

x− 12

x2 dx

=83

[7

24x2− 1

6x3]0.5

0

=83

[7

96− 1

48

]=

83· 5

96=

536

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 48: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition.

If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 49: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 50: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 51: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).

E(X +Y) = ∑x

∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 52: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y)

= ∑x

∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 53: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 54: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 55: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 56: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 57: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y)

= E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 58: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 59: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed randomvariables, then the expected value of X +Y is

E(X +Y) = E(X)+E(Y).

Proof (discrete case only).E(X +Y) = ∑

x∑y

(x+ y)p(x,y)

= ∑x

∑y

xp(x,y)+ yp(x,y)

= ∑x

∑y

xp(x,y)+∑y

∑x

yp(x,y)

= ∑x

x∑y

p(x,y)+∑y

y∑x

p(x,y)

= ∑x

xpX(x)+∑y

ypY(y) = E(X)+E(Y)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 60: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition.

If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 61: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 62: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 63: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).

E(XY) = ∑x

∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 64: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY)

= ∑x

∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 65: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y)

= ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 66: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 67: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 68: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 69: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 70: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note.

For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 71: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply.

In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 72: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house

,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 73: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

36

6= 29· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 74: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18

= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 75: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Proposition. If X and Y are jointly distributed independentrandom variables, then the expected value of XY is

E(XY) = E(X)E(Y).

Proof (discrete case only).E(XY) = ∑

x∑y

xyp(x,y) = ∑x

∑y

xypX(x)pY(y)

= ∑x

xpX(x)∑y

ypY(y)

= E(X)E(Y)

Note. For non-independent random variables, the above neednot apply. In the example with the house,

E(XY) =5

366= 2

9· 11

18= E(X)E(Y).

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 76: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition.

The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 77: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 78: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 79: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX

+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 80: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 81: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 82: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 83: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 84: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

r

rr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 85: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rr

r rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 86: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr

rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 87: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr r

rr

rrrrrr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 88: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 89: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

r

rrrrrr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 90: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rr

rrrrr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 91: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrr

rrrr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 92: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrr

rrr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 93: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 94: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

r

r

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 95: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 96: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r

r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 97: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 98: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

r

rrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 99: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rr

rr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 100: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrr

r

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 101: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 102: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

positive covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 103: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

rrr rr

rrrrr

rr

r r

rrrr

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 104: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

r r r rr r

r r rr rrr

r rr

r

r

negative covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 105: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The covariance between two jointly distributedrandom variables X and Y with expected values µX and µY isCov(X,Y) = E

((X−µX)(Y−µY)

).

y=µY

x=µX+

+

-

-

r r r rr r

r r rr rrr

r rr

r

r

negative covariance

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 106: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem.

Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 107: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y)

= E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 108: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 109: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.

Cov(X,Y) = E((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 110: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y)

= E((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 111: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)

= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 112: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)

= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 113: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)

= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 114: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 115: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 116: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 117: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. Cov(X,Y) = E(XY)−µXµY

Proof.Cov(X,Y) = E

((X−µX)(Y−µY)

)= E(XY−XµY −µXY + µXµY)= E(XY)−E(XµY)−E(µXY)+E(µXµY)= E(XY)−E(X)µY −µXE(Y)+ µXµY

= E(XY)−µXµY −µXµY + µXµY

= E(XY)−µXµY

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 118: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example.

A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

First a remark: The probability p(0,1) is not listed, becauseapparently you need to make a call to place an order.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 119: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

First a remark: The probability p(0,1) is not listed, becauseapparently you need to make a call to place an order.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 120: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

First a remark:

The probability p(0,1) is not listed, becauseapparently you need to make a call to place an order.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 121: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

First a remark: The probability p(0,1) is not listed, becauseapparently you need to make a call to place an order.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 122: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 123: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1)

= 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 124: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04

+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 125: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16

+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 126: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10

+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 127: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20

+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 128: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30

+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 129: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20

= 1.66E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20

= 0.8E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20

= 1.5Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 130: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 131: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2)

= 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 132: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04

+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 133: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16

+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 134: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10

+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 135: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20

+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 136: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30

+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 137: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20

= 0.8E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20

= 1.5Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 138: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 139: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2)

= 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 140: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04

+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 141: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16

+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 142: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10

+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 143: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20

+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 144: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30

+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 145: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20

= 1.5Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 146: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 147: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2)

= 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 148: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8

= 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 149: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

E(X1) = 0 ·0.04+1 ·0.16+1 ·0.10+2 ·0.20+2 ·0.30+2 ·0.20= 1.66

E(X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+1 ·0.30+2 ·0.20= 0.8

E(X1X2) = 0 ·0.04+0 ·0.16+1 ·0.10+0 ·0.20+2 ·0.30+4 ·0.20= 1.5

Cov(X1,X2) = 1.5−1.66 ·0.8 = 0.172

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 150: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive. But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 151: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense

: The more calls you receive,the more orders you should receive. But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 152: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive.

But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 153: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive. But it is not a no-brainer.

Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 154: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive. But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable

: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 155: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive. But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.

In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 156: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive. But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture.

(But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 157: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the covariance andinterpret the result.

A positive covariance makes sense: The more calls you receive,the more orders you should receive. But it is not a no-brainer.Beyond a certain call volume, a negative covariance is at leastconceivable: Stressed sales associates may be less efficient percall.In such a situation, a negative covariance between call volumeand customer satisfaction is a reasonable conjecture. (But thatwas not asked.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 158: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem.

If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 159: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 160: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.

Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 161: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y)

= E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 162: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 163: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 164: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY

= 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 165: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 166: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. If X and Y are independent jointly distributedrandom variables, then Cov(X,Y) = 0.

Proof.Cov(X,Y) = E(XY)−µXµY

= E(X)E(Y)−µXµY

= µXµY −µXµY = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 167: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning.

A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 168: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.

Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 169: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 170: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:

0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 171: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1)

= P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 172: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1)

wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 173: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0

and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 174: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros

, which we don’t.2. µX = µY = 0 (Marginal distributions are symmetric with

respect to zero.)3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 175: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 176: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0

(Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 177: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 178: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY)

= 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 179: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1

−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 180: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1

−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 181: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1

+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 182: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1

= 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 183: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Warning. A covariance of zero does not imply that the randomvariables are independent.Consider the following joint density function for X (across) andY (down).

−1 0 1−1 0.1 0 0.1

0 0.25 0.1 0.251 0.1 0 0.1

1. X and Y are not independent:0 = P(X = 0,Y =−1) = P(X = 0)P(Y =−1) wouldimply P(X = 0) = 0 or P(Y =−1) = 0 and then we wouldhave a row or a column of zeros, which we don’t.

2. µX = µY = 0 (Marginal distributions are symmetric withrespect to zero.)

3. Cov(X,Y) = E(XY) = 0.1−0.1−0.1+0.1 = 0.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 184: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition.

The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 185: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 186: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance

, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 187: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.”

That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 188: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate

,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 189: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.

By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 190: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable

and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 191: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

The covariance can be large if both variables have largevariance, and yet, the correlation between the variables couldstill be “large” or “small.” That is, although the sign of thecovariance tells us something about how the variables correlate,the numerical value of the covariance has limited usefulness.By dividing by the variances, we remove the influence ofvariability in one variable and obtain a standardized measure ofcorrelation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 192: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.2. Strong correlation: |ρ| ≥ 0.8.3. Moderate correlation: 0.5 < |ρ|< 0.8.4. Weak correlation: |ρ| ≤ 0.5.5. Uncorrelated: ρ = 0. (Remember that this does not mean

“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 193: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.

2. Strong correlation: |ρ| ≥ 0.8.3. Moderate correlation: 0.5 < |ρ|< 0.8.4. Weak correlation: |ρ| ≤ 0.5.5. Uncorrelated: ρ = 0. (Remember that this does not mean

“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 194: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.2. Strong correlation: |ρ| ≥ 0.8.

3. Moderate correlation: 0.5 < |ρ|< 0.8.4. Weak correlation: |ρ| ≤ 0.5.5. Uncorrelated: ρ = 0. (Remember that this does not mean

“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 195: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.2. Strong correlation: |ρ| ≥ 0.8.3. Moderate correlation: 0.5 < |ρ|< 0.8.

4. Weak correlation: |ρ| ≤ 0.5.5. Uncorrelated: ρ = 0. (Remember that this does not mean

“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 196: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.2. Strong correlation: |ρ| ≥ 0.8.3. Moderate correlation: 0.5 < |ρ|< 0.8.4. Weak correlation: |ρ| ≤ 0.5.

5. Uncorrelated: ρ = 0. (Remember that this does not mean“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 197: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.2. Strong correlation: |ρ| ≥ 0.8.3. Moderate correlation: 0.5 < |ρ|< 0.8.4. Weak correlation: |ρ| ≤ 0.5.5. Uncorrelated: ρ = 0.

(Remember that this does not mean“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 198: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Definition. The correlation coefficient of the jointlydistributed random variables X and Y is

Corr(X,Y) := ρX,Y :=Cov(X,Y)

σXσY

1. The correlation coefficient is always between −1 and 1.2. Strong correlation: |ρ| ≥ 0.8.3. Moderate correlation: 0.5 < |ρ|< 0.8.4. Weak correlation: |ρ| ≤ 0.5.5. Uncorrelated: ρ = 0. (Remember that this does not mean

“independent.”)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 199: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example.

A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 200: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 201: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172

V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20

= 0.3044V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10

+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 202: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1)

= (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20

= 0.3044V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10

+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 203: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04

+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20

= 0.3044V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10

+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 204: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16

+(1−1.66)2 ·0.10+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20

= 0.3044V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10

+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 205: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 206: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20

+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 207: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30

+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 208: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20

= 0.3044V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10

+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 209: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 210: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2)

= (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 211: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04

+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 212: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16

+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 213: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10

+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 214: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20

+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 215: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30

+(2−0.8)2 ·0.20= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 216: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 217: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Cov(X1,X2) = 0.172V(X1) = (0−1.66)2 ·0.04+(1−1.66)2 ·0.16+(1−1.66)2 ·0.10

+(2−1.66)2 ·0.20+(2−1.66)2 ·0.30+(2−1.66)2 ·0.20= 0.3044

V(X2) = (0−0.8)2 ·0.04+(0−0.8)2 ·0.16+(1−0.8)2 ·0.10+(0−0.8)2 ·0.20+(1−0.8)2 ·0.30+(2−0.8)2 ·0.20

= 0.56

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 218: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Corr(X1,X2) =Cov(X1,X2)√V(X1)

√V(X2)

=0.172√

0.3044√

0.56≈ 0.4166.

(Weak correlation.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 219: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Corr(X1,X2)

=Cov(X1,X2)√V(X1)

√V(X2)

=0.172√

0.3044√

0.56≈ 0.4166.

(Weak correlation.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 220: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Corr(X1,X2) =Cov(X1,X2)√V(X1)

√V(X2)

=0.172√

0.3044√

0.56≈ 0.4166.

(Weak correlation.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 221: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Corr(X1,X2) =Cov(X1,X2)√V(X1)

√V(X2)

=0.172√

0.3044√

0.56

≈ 0.4166.

(Weak correlation.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 222: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Corr(X1,X2) =Cov(X1,X2)√V(X1)

√V(X2)

=0.172√

0.3044√

0.56≈ 0.4166.

(Weak correlation.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 223: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Example. A company keeps track of the number of calls X1 itreceives per day and the number of orders X2 it receives perday. The joint probability mass function p(x1,x2) isp(0,0) = 0.04, p(1,0) = 0.16, p(1,1) = 0.10, p(2,0) = 0.20,p(2,1) = 0.30, p(2,2) = 0.20. Compute the correlationcoefficient.

Corr(X1,X2) =Cov(X1,X2)√V(X1)

√V(X2)

=0.172√

0.3044√

0.56≈ 0.4166.

(Weak correlation.)

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 224: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Observation.

Rounding affects correlation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 225: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Observation. Rounding affects correlation.

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 226: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem.

The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 227: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 228: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 229: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b)

=Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 230: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 231: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 232: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 233: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation

Page 234: Expected Values, Covariance and Correlation

logo1

Expected Values Covariance Examples Correlation Coefficient

Theorem. The correlation coefficient of the jointly distributedrandom variables X and Y is 1 or −1 if and only if Y = aX +bfor some a 6= 0.

Proof (one direction only).

Corr(X,aX +b) =Cov(X,aX +b)

σXσaX+b

=E(X(aX +b)

)−E(X)E(aX +b)

σX|a|σX

=aE(X2)+E(bX)−aE(X)E(X)−bE(X)

|a|σ2X

=a[E(X2)− (E(X)

)2]

|a|σ2X

=±1

Bernd Schroder Louisiana Tech University, College of Engineering and Science

Expected Values, Covariance and Correlation