christopher dougherty ec220 - introduction to econometrics (chapter 8) slideshow: model b:...
Post on 31-Mar-2015
215 Views
Preview:
TRANSCRIPT
Christopher Dougherty
EC220 - Introduction to econometrics (chapter 8)Slideshow: model b: properties of the regression coefficients
Original citation:
Dougherty, C. (2012) EC220 - Introduction to econometrics (chapter 8). [Teaching Resource]
© 2012 The Author
This version available at: http://learningresources.lse.ac.uk/134/
Available in LSE Learning Resources Online: May 2012
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 License. This license allows the user to remix, tweak, and build upon the work even for commercial purposes, as long as the user credits the author and licenses their new creations under the identical terms. http://creativecommons.org/licenses/by-sa/3.0/
http://learningresources.lse.ac.uk/
1
We will now look at the properties of the OLS regression estimators with the assumptions of Model B. We will do this within the context of the simple regression model. We will start by demonstrating unbiasedness.
ii
i
ii uaXX
YYXXb 222
iii uXY 21
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
We have seen that the slope coefficient can be decomposed into the true value plus a weighted linear combination of the values of the disturbance term in the sample, where the weights depend on the observations on X.
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
2
We now take expectations. 2 is just a constant, so it is unaffected.
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
iiii uaEuaEbE 222
3
We have now used the first expectation rule to rewrite the expectation of the linear combination as the sum of the expectations of its components.
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
iinnnnii uaEuaEuaEuauaEuaE ...... 1111
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
iiii uaEuaEbE 222
4
In Model A, the values of X were nonstochastic. This meant that the ai terms were also nonstochastic and could therefore be taken out of the expectations as factors. E(ui) = 0 for all i, and hence we proved unbiasedness.
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
222 ii uEabE
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
Model A:
iiii uaEuaEbE 222
5
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
We cannot do this with Model B because we are assuming that the values of X are generated randomly (from a defined population).
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
Model A:
iiii uaEuaEbE 222
222 ii uEabE
6
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
iiii uaEuaEbE 222
ii uYgaXfYgEXfEYgXfE )( ,)( )()()()(
Instead we appeal to Assumption B.7. We saw in the Review chapter that if X and Y are two independent random variables, the expectation of the product of functions of them can be decomposed as the product of the expectations of the functions.
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
)()()()( YgEXfEYgXfE
7
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
Under Assumption B.7, ui is distributed independently of every value of X in the sample. It is therefore distributed independently of ai. So if X and u are independent, we can make use of the decomposition.
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
iiii uaEuaEbE 222
)()()()( YgEXfEYgXfE
0)( iiii uEaEuaE
ii uYgaXf )( ,)(
8
ii
i
ii uaXX
YYXXb 222
iii uXY 21
2)(
)(
XX
XXa
i
ii
)()()()( YgEXfEYgXfE
0)( iiii uEaEuaE
222 ii uEaEbE
Since E(ui) = 0 for all I, under Assumption B.4, we have proved unbiasedness, assuming E(ai) exists. For this to be the case, there must be some variation in X in the sample (Assumption B.3). Otherwise the denominator of the expression for ai would be zero.
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
iiii uaEuaEbE 222
ii uYgaXf )( ,)(
9
The next property, efficiency, we will take for granted. The Gauss–Markov theorem assures that the OLS estimators are BLUE (best linear unbiased estimators), provided that the regression model assumptions are valid.
ii
i
ii
i
ii uaXX
uuXX
XX
YYXXb 22222
iii uXY 21
222 plim plimXX
uuXXb
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
10
We will prove consistency. We have decomposed the limiting value of the estimator of the slope coefficient into the true value and the limiting value of the error term.
ii
i
ii
i
ii uaXX
uuXX
XX
YYXXb 22222
iii uXY 21
222 plim plimXX
uuXXb
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
11
We divide the numerator and the denominator of the error term by n. We do this because they then have finite probability limits and we can make use of the plim quotient rule shown. If we did not divide by n, they would increase without limit as n increases.
22
22
22
222
)var(cov
1plim
1plim
1
1
plim
plim plim
X(X,u)
XXn
uuXXn
XXn
uuXXn
XX
uuXXb
i
ii
i
ii
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
BA
BA
plim plim
plim provided both plim A and plim B exist
12
We have now made use of the plim quotient rule.
22
22
22
222
)var(cov
1plim
1plim
1
1
plim
plim plim
X(X,u)
XXn
uuXXn
XXn
uuXXn
XX
uuXXb
i
ii
i
ii
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
13
Given the regression model assumptions, it can be shown that the denominator converges on the variance of X as the sample size becomes large, using a Law of Large Numbers. It can also be shown that the numerator converges on the covariance of X and u.
22
22
22
222
)var(cov
1plim
1plim
1
1
plim
plim plim
X(X,u)
XXn
uuXXn
XXn
uuXXn
XX
uuXXb
i
ii
i
ii
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
14
Assumption B.7 states that the covariance of X and u is zero. Hence we have proved consistency, provided that the regression model assumptions are valid.
22
22
22
222
)var(cov
1plim
1plim
1
1
plim
plim plim
X(X,u)
XXn
uuXXn
XXn
uuXXn
XX
uuXXb
i
ii
i
ii
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
15
Finally, a note on Assumption B.8, that the disturbance term has a normal distribution. The justification is that it is reasonable to suppose that the disturbance term is jointly generated by a number of minor random factors.
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
16
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
A central limit theorem states that the combination of these factors should approximately have a normal distribution, even if the individual factors do not.
17
ii
i
ii uaXX
YYXXb 222
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
If the disturbance term has a normal distribution, the regression coefficients also have normal distributions. This follows from the fact that a linear combination of normal distributions is also normal.
18
ii
i
ii uaXX
YYXXb 222
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
What happens if we have reason to believe that the assumption is not valid? The central limit theorem comes into the frame a second time.
19
ii
i
ii uaXX
YYXXb 222
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
The random component of a regression coefficient is a linear combination of the values of the disturbance term in the sample.
20
ii
i
ii uaXX
YYXXb 222
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
By a central limit theorem, it follows that the combination will have an approximately normal distribution, even if the individual values of the disturbance term do not, provided that the sample is large enough.
21
ii
i
ii uaXX
YYXXb 222
2)(
)(
XX
XXa
i
ii
MODEL B: PROPERTIES OF THE REGRESSION COEFFICIENTS
ASSUMPTIONS FOR MODEL B
B.5 The disturbance term is homoscedastic.
B.6 The values of the disturbance term have independent distributions
B.7 The disturbance term is distributed independently of the regressors
B.8 The disturbance term has a normal distribution
Hence asymptotically (in large samples) it ought to be safe to assume that the regression coefficients have normal distributions, even if Assumption B.8 is invalid, provided that the other regression model assumptions are satisfied.
22
ii
i
ii uaXX
YYXXb 222
2)(
)(
XX
XXa
i
ii
Copyright Christopher Dougherty 2011.
These slideshows may be downloaded by anyone, anywhere for personal use.Subject to respect for copyright and, where appropriate, attribution, they may be used as a resource for teaching an econometrics course. There is no need to refer to the author.
The content of this slideshow comes from Section 8.3 of C. Dougherty, Introduction to Econometrics, fourth edition 2011, Oxford University Press. Additional (free) resources for both students and instructors may be downloaded from the OUP Online Resource Centre http://www.oup.com/uk/orc/bin/9780199567089/.
Individuals studying econometrics on their own and who feel that they might benefit from participation in a formal course should consider the London School of Economics summer school courseEC212 Introduction to Econometrics http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspxor the University of London International Programmes distance learning course20 Elements of Econometricswww.londoninternational.ac.uk/lse.
11.07.24
top related