type i and type iii sums of squares 1. confounding in unbalanced designs when designs are...

23
BIBD and Adjusted Sums of Squares Type I and Type III Sums of Squares 1

Upload: clifton-hutchinson

Post on 14-Dec-2015

217 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

1

BIBD and Adjusted Sums of SquaresType I and Type III Sums of Squares

Page 2: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

2

Confounding in Unbalanced DesignsWhen designs are “unbalanced”, typically

with missing values, our estimates of Treatment Effects can be biased.

When designs are “unbalanced”, the usual computation formulas for Sums of Squares can give misleading results, since some of the variability in the data can be explained by two or more variables.

Page 3: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

3

Example BIBD from Hicks

Page 4: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

4

Type I vs. Type III in partitioning variation

If an experimental design is not a balanced and complete factorial design, it is not an orthogonal design.

If a two factor design is not orthogonal, then the SSModel will not partition into unique components, i.e., some components of variation may be explained by either factor individually (or simultaneously).

Type I SS are computing according to the order in which terms are entered in the model.

Type III SS are computed in an order independent fashion, i.e. each term gets the SS as though it were the last term entered for Type I SS.

Page 5: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

5

Notation for Hicks’ example

There are only two possible factors, Block and Trt. There are only three possible simple additive models one could run. In SAS syntax they are:

Model 1: Model Y=Block;Model 2: Model Y=Trt;Model 3: Model Y=Block Trt;

Page 6: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

6

Adjusted SS notation

Each model has its own “Model Sums of Squares”.

These are used to derive the “Adjusted Sums of

Squares”.

SS(Block)=Model Sums of Squares for Model 1

SS(Trt)=Model Sums of Squares for Model 2

SS(Block,Trt)=Model Sums of Squares for Model 3

Page 7: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

7

The Sums of Squares for Block and Treatment can be adjusted to remove any possible confounding.

Adjusting Block Sums of Squares for the effect

of Trt:

SS(Block|Trt)= SSModel(Block,Trt)- SSModel(Trt)

Adjusting Trt Sums of Squares for the effect of

Block:

SS(Trt|Block)= SSModel(Block,Trt)- SSModel(Block)

Page 8: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

8

From Hicks’ Example

SS(Block)=100.667

SS(Trt)=975.333

SS(Block,Trt)=981.500

Page 9: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

9

For SAS model Y=Block Trt;

Source df Type I SS Type III SS

Block 3 SS(Block) SS(Block|Trt)

=100.667 =981.50-975.333

Trt 3 SS(Trt|Block) SS(Trt|Block)

=981.50-100.667 =981.50-100.667

Page 10: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

10

ANOVA Type III and Type I(Block first term in Model)

Page 11: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

11

For SAS model Y=Trt Block;

Source df Type I SS Type III SSTrt 3 SS(Trt) SS(Trt|Block)

=975.333 =981.50-100.667

Block 3 SS(Block|Trt) SS(Block|Trt)

=981.50-975.333 =981.50-975.333

Page 12: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

12

ANOVA Type III and Type I(Trt. First term in Model)

Page 13: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

13

How does variation partition?

SS Total Variation

Block TRT Block or Trt Error

Page 14: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

14

How this can work-IHicks example

Page 15: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

15

When does case I happen?

In Regression, when two Predictor variables are positively correlated, either one could explain the “same” part of the variation in the Response variable. The overlap in their ability to predict is what is adjusted “out” of their Sums of Squares.

Page 16: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

16

Example BIBDFrom Montgomery (things can go the other way)

Page 17: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

17

ANOVA with Adjusted and Unadjusted Sums of Squares

Page 18: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

18

Sequential Fit with Block first

Page 19: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

19

Sequential Fit with Treatment first

Page 20: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

20

LS Means Plot

Page 21: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

21

LS Means for Treatment, Tukey HSD

Page 22: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

22

How this can work- IIMontgomery example

Page 23: Type I and Type III Sums of Squares 1. Confounding in Unbalanced Designs When designs are “unbalanced”, typically with missing values, our estimates of

23

When does case II happen?

Sometimes two Predictor variables can predict the Response better in combination than the total of they might predict by themselves. In Regression this can occur when Predictor variables are negatively correlated.