building conceptual understanding of statistical inference patti frazer lock cummings professor of...
TRANSCRIPT
![Page 1: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/1.jpg)
Building Conceptual Understanding of Statistical
Inference
Patti Frazer Lock Cummings Professor of Mathematics
St. Lawrence [email protected]
Glendale – High School Math CollaborativeJanuary 2013
![Page 2: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/2.jpg)
The Lock5 Team
DennisIowa State
KariHarvard/Duke
EricUNC/Duke
Robin & PattiSt. Lawrence
![Page 3: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/3.jpg)
Increasingly important for our students (and us)
An expanding part of the high school (and college) curriculum
Statistics
![Page 4: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/4.jpg)
• General overview of the key ideas of statistical inference
• Introduction to new simulation methods in statistics
• Free resources to use in teaching statistics or math
This Presentation
![Page 5: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/5.jpg)
New Simulation Methods
“The Next Big Thing”
Common Core State Standards in Mathematics
Outstanding for helping students understand the key ideas of statistics
Increasingly important in statistical analysis
![Page 6: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/6.jpg)
“New” Simulation Methods?
"Actually, the statistician does not carry out this very simple and very tedious process, but his conclusions have no justification beyond the fact that they agree with those which could have been arrived at by thiselementary method."
-- Sir R. A. Fisher, 1936
![Page 7: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/7.jpg)
We need a snack!
![Page 8: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/8.jpg)
What proportion of Reese’s Pieces are
Orange?Find the proportion that are orange
for your “sample”.
![Page 9: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/9.jpg)
Proportion orange in 100 samples of size n=100
BUT – In practice, can we really take lots of samples from the same population?
![Page 10: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/10.jpg)
Statistical Inference• Using information from a sample to infer
information about a larger population.
Two main areas:• Confidence Intervals (to estimate)
• Hypothesis Tests (to make a decision)
![Page 11: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/11.jpg)
First: Confidence Intervals
![Page 12: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/12.jpg)
Example 1: What is the average price of a used Mustang car?
We select a random sample of n=25 Mustangs from a website (autotrader.com) and record the price (in $1,000’s) for each car.
![Page 13: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/13.jpg)
Sample of Mustangs:
Our best estimate for the average price of used Mustangs is $15,980, but how accurate is that estimate?
Price0 5 10 15 20 25 30 35 40 45
MustangPrice Dot Plot
𝑛=25 𝑥=15.98 𝑠=11.11
![Page 14: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/14.jpg)
Our best estimate for the average price of used Mustangs is $15,980, but how accurate is that estimate?
We would like some kind of margin of error or a confidence interval.
Key concept: How much can we expect the sample means to vary just by random chance?
![Page 15: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/15.jpg)
Traditional Inference2. Which formula?
3. Calculate summary stats
6. Plug and chug
𝑥± 𝑡∗ ∙𝑠
√𝑛𝑥± 𝑧∗ ∙𝜎√𝑛
,
4. Find t*
95% CI
5. df?
df=251=24
OR
t*=2.064
15.98±2 .064 ∙11.11
√25
15.98±4.59=(11.39 ,20.57)7. Interpret in context
CI for a mean1. Check conditions
![Page 16: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/16.jpg)
“We are 95% confident that the mean price of all used Mustang cars is between $11,390 and $20,570.”
We arrive at a good answer, but the process is not very helpful at building understanding of the key ideas.
In addition, our students are often great visual learners but some get nervous about formulas and algebra. Can we find a way to use their visual intuition?
![Page 17: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/17.jpg)
Bootstrapping
Assume the “population” is many, many copies of the original sample.
“Let your data be your guide.”
![Page 18: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/18.jpg)
Suppose we have a random sample of 6 people:
![Page 19: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/19.jpg)
Original Sample
A simulated “population” to sample from
![Page 20: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/20.jpg)
Bootstrap Sample: Sample with replacement from the original sample, using the same sample size.
Original Sample Bootstrap Sample
![Page 21: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/21.jpg)
How would we take a bootstrap sample from one Reese’s Pieces bag?
![Page 22: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/22.jpg)
Original Sample Bootstrap Sample
![Page 23: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/23.jpg)
Original Sample
BootstrapSample
BootstrapSample
BootstrapSample
●●●
Bootstrap Statistic
Sample Statistic
Bootstrap Statistic
Bootstrap Statistic
●●●
Bootstrap Distribution
![Page 24: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/24.jpg)
We need technology!
StatKeywww.lock5stat.com
![Page 25: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/25.jpg)
Using the Bootstrap Distribution to Get a 95% Confidence Interval
Keep 95% in middle
Chop 2.5% in each tail
Chop 2.5% in each tail
We are 95% sure that the mean price for Mustangs is between $11,930 and $20,238
![Page 26: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/26.jpg)
Example 2: Let’s collect some data from you. What yes/no question shall we ask you?
We will use you as a sample to estimate the proportion of all secondary math teachers in southern California that would say yes to this question.
![Page 27: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/27.jpg)
Why does the bootstrap
work?
![Page 28: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/28.jpg)
Sampling Distribution
Population
µ
BUT, in practice we don’t see the “tree” or all of the “seeds” – we only have ONE seed
![Page 29: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/29.jpg)
Bootstrap Distribution
Bootstrap“Population”
What can we do with just one seed?
Grow a NEW tree!
𝑥
Estimate the distribution and variability (SE) of ’s from the bootstraps
µ
![Page 30: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/30.jpg)
Example 3: Diet Cola and Calcium What is the difference in mean amount of calcium excreted between people who drink diet cola and people who drink water?Find a 95% confidence interval for the difference in means.
![Page 31: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/31.jpg)
Example 3: Diet Cola and Calcium www.lock5stat.com
StatkeySelect “CI for Difference in Means”Use the menu at the top left to find the correct dataset.Check out the sample: what are the sample sizes? Which group excretes more in the sample? Generate one bootstrap statistic. Compare it to the original.Generate a full bootstrap distribution (1000 or more). Use the “two-tailed” option to find a 95% confidence interval for the difference in means. What is your interval? Compare it with your neighbors.Is zero (no difference) in the interval? (If not, we can be confident that there is a difference.)
![Page 32: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/32.jpg)
What About Hypothesis Tests?
![Page 33: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/33.jpg)
P-value: The probability of seeing results as extreme as, or more extreme than, the sample results, if the null hypothesis is true.
Say what????
![Page 34: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/34.jpg)
Example 1: Beer and Mosquitoes
Does consuming beer attract mosquitoes? Experiment: 25 volunteers drank a liter of beer,18 volunteers drank a liter of waterRandomly assigned!Mosquitoes were caught in traps as they approached the volunteers.1
1 Lefvre, T., et. al., “Beer Consumption Increases Human Attractiveness to Malaria Mosquitoes, ” PLoS ONE, 2010; 5(3): e9546.
![Page 35: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/35.jpg)
Beer and Mosquitoes
Beer mean = 23.6
Water mean = 19.22
Does drinking beer actually attract mosquitoes, or is the difference just due to random chance?
Beer mean – Water mean = 4.38
Number of Mosquitoes
Beer Water 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
![Page 36: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/36.jpg)
Traditional Inference
1 2
2 21 2
1 2
s sn n
X X
2. Which formula?
3. Calculate numbers and plug into formula
4. Plug into calculator
5. Which theoretical distribution?
6. df?
7. find p-value
0.0005 < p-value < 0.001
187.3
251.4
22.196.2322
68.3
1. Check conditions
![Page 37: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/37.jpg)
Simulation Approach
Beer mean = 23.6
Water mean = 19.22
Does drinking beer actually attract mosquitoes, or is the difference just due to random chance?
Beer mean – Water mean = 4.38
Number of Mosquitoes
Beer Water 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
![Page 38: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/38.jpg)
Simulation ApproachNumber of Mosquitoes
Beer Water 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
Find out how extreme these results would be, if there were no difference between beer and water.
What kinds of results would we see, just by random chance?
Number of Mosquitoes
Beverage 27 21 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
![Page 39: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/39.jpg)
Simulation ApproachBeer Water
Find out how extreme these results would be, if there were no difference between beer and water.
What kinds of results would we see, just by random chance?
Number of Mosquitoes
Beverage 20 22 21 15 26 12 27 21 31 16 24 19 19 15 23 24 24 19 28 23 19 13 24 22 29 20 20 24 17 18 31 20 20 22 25 28 21 27 21 18 20
27 21
2127241923243113182425211812191828221927202322
2026311923152212242920272917252028
![Page 41: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/41.jpg)
Traditional Inference
1 2
2 21 2
1 2
s sn n
X X
1. Which formula?
2. Calculate numbers and plug into formula
3. Plug into calculator
4. Which theoretical distribution?
5. df?
6. find p-value
0.0005 < p-value < 0.001
187.3
251.4
22.196.2322
68.3
![Page 42: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/42.jpg)
Beer and MosquitoesThe Conclusion!
The results seen in the experiment are very unlikely to happen just by random chance (just 1 out of 1000!)
We have strong evidence that drinking beer does attract mosquitoes!
![Page 43: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/43.jpg)
“Randomization” Samples
Key idea: Generate samples that are
(a) based on the original sample AND(b) consistent with some null hypothesis.
![Page 44: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/44.jpg)
• In a randomized experiment on treating cocaine addiction, 48 people were randomly assigned to take either Desipramine (a new drug), or Lithium (an existing drug)
• The outcome variable is whether or not a patient relapsed
• Is Desipramine significantly better than Lithium at treating cocaine addiction?
Example 2: Cocaine Addiction
![Page 45: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/45.jpg)
R R R R R R
R R R R R R
R R R R R R
R R R R R R
R R R R R R
R R R R R R
R R R R R R
R R R R R R
R R R R
R R R R R R
R R R R R R
R R R R R R
R R R R
R R R R R R
R R R R R R
R R R R R R
Desipramine Lithium
1. Randomly assign units to treatment groups
![Page 46: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/46.jpg)
R R R R
R R R R R R
R R R R R R
N N N N N N
RRR R R R
R R R R N N
N N N N N N
RR
N N N N N N
R = RelapseN = No Relapse
R R R R
R R R R R R
R R R R R R
N N N N N N
RRR R R R
R R R R RR
R R N N N N
RR
N N N N N N
2. Conduct experiment
3. Observe relapse counts in each group
LithiumDesipramine
10 relapse, 14 no relapse 18 relapse, 6 no relapse
1. Randomly assign units to treatment groups
10 18
24
ˆ ˆ
24.333
new oldp p
![Page 47: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/47.jpg)
R R R R
R R R R R R
R R R R R R
N N N N N N
RRR R R R
R R R R N N
N N N N N N
RR
N N N N N N
10 relapse, 14 no relapse 18 relapse, 6 no relapse
![Page 48: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/48.jpg)
R R R R R R
R R R R N N
N N N N N N
N N N N N N
R R R R R R
R R R R R R
R R R R R R
N N N N N N
R N R N
R R R R R R
R N R R R N
R N N N R R
N N N R
N R R N N N
N R N R R N
R N R R R R
Simulate another randomization
Desipramine Lithium
16 relapse, 8 no relapse 12 relapse, 12 no relapse
ˆ ˆ16 12
24 240.167
N Op p
![Page 49: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/49.jpg)
R R R R
R R R R R R
R R R R R R
N N N N N N
RRR R R R
R N R R N N
R R N R N R
RR
R N R N R R
Simulate another randomization
Desipramine Lithium
17 relapse, 7 no relapse 11 relapse, 13 no relapse
ˆ ˆ17 11
24 240.250
N Op p
![Page 50: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/50.jpg)
• Start with 48 cards (Relapse/No relapse) to match the original sample.
•Shuffle all 48 cards, and rerandomize them into two groups of 24 (new drug and old drug)
• Count “Relapse” in each group and find the difference in proportions, .
• Repeat (and collect results) to form the randomization distribution.
• How extreme is the observed statistic of 0.33?
Physical Simulation
![Page 51: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/51.jpg)
Example 3: Malevolent Uniforms
Do sports teams with more “malevolent” uniforms get penalized more often?
![Page 52: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/52.jpg)
Example 3: Malevolent Uniforms
Sample Correlation = 0.43
Do teams with more malevolent uniforms commit more penalties, or is the relationship just due to random chance?
![Page 53: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/53.jpg)
Simulation Approach
Find out how extreme this correlation would be, if there is no relationship between uniform malevolence and penalties.
What kinds of results would we see, just by random chance?
Sample Correlation = 0.43
![Page 54: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/54.jpg)
Randomization by ScramblingOriginal sample
MalevolentUniformsNFL
NFLTeam NFL_Ma... ZPenYds <new>
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
LA Raiders 5.1 1.19
Pittsburgh 5 0.48
Cincinnati 4.97 0.27
New Orl... 4.83 0.1
Chicago 4.68 0.29
Kansas ... 4.58 -0.19
Washing... 4.4 -0.07
St. Louis 4.27 -0.01
NY Jets 4.12 0.01
LA Rams 4.1 -0.09
Cleveland 4.05 0.44
San Diego 4.05 0.27
Green Bay 4 -0.73
Philadel... 3.97 -0.49
Minnesota 3.9 -0.81
Atlanta 3.87 0.3
Indianap... 3.83 -0.19
San Fra... 3.83 0.09
Seattle 3.82 0.02
Denver 3.8 0.24
Tampa B... 3.77 -0.41
New Eng... 3.6 -0.18
Buffalo 3.53 0.63
Scrambled MalevolentUniformsNFL
NFLTeam NFL_Ma... ZPenYds <new>
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
LA Raiders 5.1 0.44
Pittsburgh 5 -0.81
Cincinnati 4.97 0.38
New Orl... 4.83 0.1
Chicago 4.68 0.63
Kansas ... 4.58 0.3
Washing... 4.4 -0.41
St. Louis 4.27 -1.6
NY Jets 4.12 -0.07
LA Rams 4.1 -0.18
Cleveland 4.05 0.01
San Diego 4.05 1.19
Green Bay 4 -0.19
Philadel... 3.97 0.27
Minnesota 3.9 -0.01
Atlanta 3.87 0.02
Indianap... 3.83 0.23
San Fra... 3.83 0.04
Seattle 3.82 -0.09
Denver 3.8 -0.49
Tampa B... 3.77 -0.19
New Eng... 3.6 -0.73
Buffalo 3.53 0.09
Scrambled sample
![Page 56: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/56.jpg)
Malevolent UniformsThe Conclusion!
The results seen in the study are unlikely to happen just by random chance (just about 1 out of 100).
We have some evidence that teams with more malevolent uniforms get more penalties.
![Page 57: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/57.jpg)
P-value: The probability of seeing results as extreme as, or more extreme than, the sample results, if the null hypothesis is true.
Yeah – that makes sense!
![Page 58: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/58.jpg)
Example 4: Light at Night and Weight Gain
Does leaving a light on at night affect weight gain? In particular, do mice with a light on at night gain more weight than mice with a normal light/dark cycle?Find the p-value and use it to make a conclusion.
![Page 59: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/59.jpg)
Example 4: Light at Night and Weight Gain
www.lock5stat.com
StatkeySelect “Test for Difference in Means”Use the menu at the top left to find the correct dataset (Fat Mice).Check out the sample: what are the sample sizes? Which group gains more weight? (LL = light at night, LD = normal light/dark) Generate one randomization statistic. Compare it to the original.Generate a full randomization (1000 or more). Use the “right-tailed” option to find the p-value. What is your p-value? Compare it with your neighbors.Is the sample difference of 5 likely to be just by random chance?What can we conclude about light at night and weight gain?
![Page 60: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/60.jpg)
Simulation Methods• These randomization-based methods tie directly to the key ideas of statistics.
• They are ideal for building conceptual understanding of the key ideas.
• Students are very visual learners and really appreciate the visual nature of these methods.
• Not only are these methods great for teaching statistics, but they are increasingly being used for doing statistics.
![Page 61: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/61.jpg)
How does everything fit together?• We use these methods to build understanding of the key ideas.
• We then cover traditional normal and t-tests as “short-cut formulas”.
• Students continue to see all the standard methods but with a deeper understanding of the meaning.
![Page 62: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/62.jpg)
It is the way of the past…
"Actually, the statistician does not carry out this very simple and very tedious process, but his conclusions have no justification beyond the fact that they agree with those which could have been arrived at by this elementary method."
-- Sir R. A. Fisher, 1936
![Page 63: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/63.jpg)
… and the way of the future“... the consensus curriculum is still an unwitting prisoner of history. What we teach is largely the technical machinery of numerical approximations based on the normal distribution and its many subsidiary cogs. This machinery was once necessary, because the conceptually simpler alternative based on permutations was computationally beyond our reach. Before computers statisticians had no choice. These days we have no excuse. Randomization-based inference makes a direct connection between data production and the logic of inference that deserves to be at the core of every introductory course.”
-- Professor George Cobb, 2007
![Page 64: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/64.jpg)
Additional Resourceswww.lock5stat.com
Statkey• Descriptive Statistics• Sampling Distributions (Reese’s Pieces!)
• Normal and t-Distributions
![Page 65: Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University plock@stlawu.edu](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649e045503460f94af0a79/html5/thumbnails/65.jpg)
Thanks for joining me!
www.lock5stat.com