This video is designed to accompany
Module 2 in
Beyond the Numbers Student-Centered Activities for Learning
Statistical Reasoning a publication of the Van-Griner Publishing Company
! To make inferences about a population from what we know about our sample data …
! Not something we can do perfectly…
! But it is something we can do probabilistically
Goal of Sampling
! Basically we want to be able to estimate numbers in the population that we don’t know, using numbers we do know from our sample.
! And we want to be able to say something mathematically meaningful about how much confidence we have in our estimation procedure.
Probabilistically?
! Once the sample is determined, data may be collected a variety of ways.
! Survey Monkey is a popular, free on-line survey tool.
! Even if the sample is taken the right way, there is the additional issue of the integrity of the data measurements.
Data Collection
Sampling from Biased Lists
1936 Literary Digest poll that forecast Landon would defeat FDR by 57% to 43%.
The Digest used lists of telephone and automobile owners to select their sample, which targeted middle- and upper-class citizens who voted for Landon.
The lower classes voted for Roosevelt.
Common Sense First
Voluntary Response
Ann Landers had 10,000 responses and about 70% said “NO!”
Wise follow-up by Landers “People who are contented are rarely motivated to write and tell me
how happy they are. Anger, hostility and resentment are often the fuel that moves people to action.”
Hints at an understanding of the bias in voluntary response “surveys.”
“If you had to do it over again, would you have children?”
Follow-up
Newsday commissioned a nationwide poll of 1373 parents and used “statistical sampling.”
Found that 91% would have children again!
So How Bad Was the Bias?
Intentional Bias
2000 Republican Primaries
Bush camp asked voters in South Carolina: "Would you be more likely or less likely to vote for John
McCain for president if you knew he had fathered an illegitimate black child?"
Push Polls “push” respondents in a certain direction.
Inferences with push poll data are nonsense.
Push Polls
! Biased samples tend to systematically favor certain outcomes.
! With biased samples you can’t say anything meaningful about how good your estimates are.
! The science of statistics is about what you can say when you take samples the right way.
Briefly Said