other ways of thinking about interactions ways of describing interactions other than simple effects...

16
Other Ways of Thinking About Interactions • Ways of Describing Interactions other than “Simple Effects” • Interactions as “other kinds of” cell mean difference patterns • Interactions as “non-additive combinations” of IV effects • augmenting vs. interfering interactions • Describing “interactions” vs. “data patterns” • isolating the interaction effect

Upload: basil-stone

Post on 18-Jan-2018

216 views

Category:

Documents


0 download

DESCRIPTION

Sometimes our hypotheses aren’t about patterns of simple effects, but … are about other kinds of mean difference patterns… The IVs are “Training Modality” and “Testing Modality” leading to this 2x2 factorial design… VV Training Modality Visual Touch VT TT TV Testing Modality Touch Visual Among these conditions, 2 are “intramodal” (VV & TT) & 2 are “cross-modal” (VT & TV). RH:s for the study were… RH1: VV > TT  hypothesized dif among intramodal conditions RH2: VT > TV  hypothesized dif among cross-modal conditions Neither of which corresponds to a “simple effect” !! REM! LSDmmd can be used to compare among any of the cells!

TRANSCRIPT

Page 1: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Other Ways of Thinking About Interactions

• Ways of Describing Interactions other than “Simple Effects”

• Interactions as “other kinds of” cell mean difference patterns

• Interactions as “non-additive combinations” of IV effects

• augmenting vs. interfering interactions

• Describing “interactions” vs. “data patterns”

• isolating the interaction effect

Page 2: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Generally folks define, identify, and describe interactions in terms of “different differences” or “different simple effects,” as we have done so far…

Task Presentation Paper Computer

Task DifficultyEasy 90 = 90 one simple effect “null”

Hard 40 < 70 one simple effect

However, that’s not the only way to define, indentify or describe interactions…

Page 3: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Sometimes our hypotheses aren’t about patterns of simple effects, but … are about other kinds of mean difference patterns…

The IVs are “Training Modality” and “Testing Modality” leading to this 2x2 factorial design…

VV

Training ModalityVisual Touch

VT TT

TV

Test

ing

Mod

ality

Touc

h

Vis

ual

Among these conditions, 2 are “intramodal” (VV & TT) & 2 are “cross-modal” (VT & TV).

RH:s for the study were…RH1: VV > TT hypothesized dif among intramodal conditionsRH2: VT > TV hypothesized dif among cross-modal conditions

Neither of which corresponds to a “simple effect” !!REM! LSDmmd can be used to compare among any of the cells!

Page 4: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

At the time, using LSDmmd hadn’t “caught on” yet, and since neither RH: corresponds to a SE, folks would use separate t-tests to compare each cell pair – leading several to make Type II errors because of the lowered power…

VV

Training ModalityVisual Touch

VT

TT

TV

Test

ing

Mod

ality

Cro

ss

In

tra

In this case there is an “organizational” solution…Just re-label the IVs…“Training Modality” Vision vs. Touch & “Testing Modality” Intramodal vs. Cross-modal then…

The “significant interaction that isn’t anywhere” we’ve discussed!

RH1: VV > TT SE of Training Modality for Intramodal testsRH2: VT > TV SE of Training Modality for Cross-modal tests

Page 5: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Per

form

ance

99.6%

Training ModalityVisual Touch

26.2 %

Test

ing

Mod

ality

Touc

h

Vis

ual

25.6 %

24.8 %

… which can be directly & completely tested using the 6 pairwise comparisons among the 4 conditions.

VV VT TV TT

Another Example – same research area…

This was the common design for studying intra- and cross-modal memory with the usual RH: VV > VT = TV = TT

After several studies, someone noticed that these conditions define a factorial…

Page 6: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

99.6%

Training ModalityVisual Touch

26.2 %

Test

ing

Mod

ality

Touc

h

Vis

ual

25.6 %

24.8 %

There was an interaction!

There was a (misleading) main effect of Training Modality.

There was a (misleading) main effect of Testing Modality.

However interesting and informative was the idea from the significant interaction, that “performance is the joint effect of Training and Testing Modalities” – none of these “effect tests” give a direct test of the RH:

The set of pairwise comparisons gives the most direct RH test!!!

Notice how the very large VV cell mean “drives” both main effects (while ensuring they will each be misleading) as well as driving the interaction!?!

Page 7: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Here’s yet another way of thinking about interactions… we’ll need an example!!

Brownies – great things… worthy of serious theory & research!!!

The usual brownie is made with 4 blocks of chocolate and 2 cups of sugar. Replicated research tells us that the average rating of brownies made with this recipe is about 3 on a 10-point scale.

My theory? People don’t really like brownies! What they really like is fudge! So, goes my theory, making brownies more “fudge-like” will make them better liked.

How to make them more fudge-like, you ask?

Add more sugar & more chocolate!!!

Page 8: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

So, we made up several batches of brownies and asked people to taste a standardized amount of brownie after rinsing their mouth with water, eating an unsalted saltine cracker and rinsing their mouth a second time. We used the same 10-point rating scale; 1 = this is the worst plain brownie I’ve ever had, 10=this is the best plain brownie I’ve ever had.

Our first study:

2-cups of sugar 4-cups of sugar

3 5

So, far so good!

Page 9: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Our second study:

4 blocks of choc.

3 2

8 blocks of choc.

What???? Oh – yeah! Unsweetened chocolate…

Then the argument started..

One side: We have partial support for the theory – addingsugar helps, but adding chocolate hurts!!!

Other side: We have not tested the theory!!!

What was our theory?Add more sugar & more chocolate!!! We need a better design!

Page 10: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

4 blocks of choc.

3 2

8 blocks of choc.

2-cups of sugar

4-cups of sugar

5

What do we expect for the 4-cup & 8-block brownies? standard brownie+ sugar effect+ chocolate effect expected additive effect of choc & sugar expected score for 4&8 brownies

3 + 2 - 1 1 4

Page 11: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

4 blocks of choc.

3 2

8 blocks of choc.

2-cups of sugar

4-cups of sugar 5

How do we account for this ?

9

There is a non-additive joint effect of chocolate and sugar!!!!

The joint effect of adding chocolate and sugar is not predictable as the sum of the effects of adding each!!!

Said differently, there is an interaction of chocolate and sugar that emerges when they are added simultaneously.

The effect of adding both simultaneously is 6 … not 4???

Page 12: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

This leads to the distinction between two “kinds” of interactions…

“Augmenting” Interaction

10

# practices10 30

~FB

FB 20 45

15

The combined effect is greater than would be

expected as the additive effect!

“Interfering” Interaction

10~Aud

Aud

~Rew Rew

25 15

20

The combined effect is less than would be expected as

the additive effect!

Practice effect = 5Feedback effect = 10Expected additive effect = 15Joint effect = 35

“Augmenting” Interaction

45

Reward effect = 10Audience effect = 15Expected additive effect = 25Joint effect = 5

“Interfering” Interaction“Interfering” Interaction“Interfering” Interaction

Page 13: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

“Describing a pattern of data that includes an interaction” vs.“Describing the Interaction in a pattern of data”

90 70 50 30

Paper Computer

Task Presentation

The pattern of data shown the figure demonstrate that while Task Presentation has no effect for Easy tasks, for Hard tasks, those using Computer did better than when using Paper.This is “a description of a pattern of data that includes an interaction”

Technically, it would be wrong to say that “The interaction shown in the figure demonstrates that while Task Presentation has no effect for Easy tasks, for Hard tasks, those using Computer did better than when using Paper.

In order to “describe the interaction effect” we have to isolate the “interaction effect” from the main effects…

Easy

Hard

Page 14: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

The process, called “mean polishing,” involves residulaizing the data for the main effects, leaving the interaction effect… Presentation Paper Comp means row effect Easy 90 90 90 +15 Hard 50 70 60 -15 means 70 80 75 grand mean

col effect -5 +5

Correcting for row effects (subtract +/- 15)

Presentation Paper Comp Easy 75 75 Hard 65 85

Correcting for column effects (subtract +/- 5)

Presentation Paper Comp Easy 80 70 Hard 70 80

Page 15: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Correcting for Grand Mean (subtract 75)

Presentation Paper Comp Easy 5 -5 Hard -5 5

10 5 0 -5 -10

Paper Computer

Task Presentation

Easy

Hard

The proper description of “the interaction effect” is

The interaction shown in the figure demonstrates that for Easy tasks those using Paper performed better than those using Computer, however, for Hard tasks, those using Computer performed better than those using Paper.

Hard

Easy

Hard

Page 16: Other Ways of Thinking About Interactions Ways of Describing Interactions other than Simple Effects Interactions as other kinds of cell mean difference

Looked at in this way, interactions differ in only 2 ways…

Which group has “increase” and which had “decrease”

Easy

Hard

vs.Easy

Hard

The “strength” of the interaction effect…

Easy

Hard

Easy

Hard

Easy

Hard

Easy

Hard

Easy

Hard

Easy

Hard

Easy

Hard

EasyEasy

Hard

Easy

Hard

null small medium large