deanna e. white, adam stevens, john barbaro, kristy mcgill and lynne russell

43
Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Upload: buddy-maximillian-white

Post on 27-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Page 2: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

2

What is RRFSS

Rapid Risk Factor SurveillanceSystem

Page 3: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Key Public Health Issues Able to Monitor

Family History

Obesity

Hypertension

Diabetes

Smoking

Page 4: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

to New Public Health Issues Adaptable

Page 5: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

5

Local

Page 6: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Timely

Page 7: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

7

How Can We Use RRFSS?

• To support program planning and evaluation

• To advocate for public policy development

• To improve community awareness of risks for CDs, IDs and injuries

Page 8: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Who Can Join RRFSS?

Any Public Health Unit in Ontario

… but thereis a cost.

Page 9: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

9

When is the Survey Conducted?

• There are three 4-month data cyclesper year.

Page 10: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

10

How is Data Collected

• Institute for Social Research (ISR) at York University

Page 11: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

11

How Long is the Survey?

Page 12: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

12

How is the Questionnaire Organized?

Page 13: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

13

• Decided annually by all participating HUs

• Asked for at least one year

• May rotate alternating years

• Mandatory – CANNOT opt out of these

AGE SEX BMI TOBACCOUSE INCOME

Page 14: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

• Selected by each HU individually

• Can add or delete each cycle

Page 15: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

What are some of the Topics/Modules?

See QMap

Your Turn!Are there any topics you would be interested in? Please circle the topic.

Page 16: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

16

Must We Use the Entire Module?

But …• Must start at the beginning

of a module

• Cannot jump back in once stopped

No

Page 17: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Can We Develop Modules?

Yesbut you must followa process:• Complete Module Submission

Request Form

• Should be applicable to multiple PHUs

• Can work with your own if no other PHU interested

Page 18: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

How to Choose Optional

• Align with health unit’s data needs

• Measure the variable over time(decrease in chronic disease prevalence?)

• Data is not available from other data sources(use and awareness of parenting programs)

Page 19: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

What is the Sample Size?

400 3 1,200interviews/HU cycles/year interviews/year

RRFSS has a larger sample size than the CCHS in some PHUs.

Page 20: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Who is Included in the Sample?

• 18 years of age and older

• English or French speaking

• Reside in private homes

• With landline

* some cell phone numbers were included

Page 21: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

21

Is the Sample Size Big Enough?

Page 22: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

22

Sampling Procedures

• Random selection of households – using random digit dialing

• Random selection of respondent – household member with next birthday

Page 23: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

23

Household Weights

• Maximize ability to generalize the survey results (the sample) to the population

• Probability of selection depends on size of household

Page 24: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Household Weights

Size ofHousehold

ChanceSelected

Weight

1adult

2adults

3adults

100% Given weight of 1

50% Given weight of 2

33.3% Given weight of 3

This helps to prevent under-representation in larger households and over-representation in small households.

Page 25: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Calculations were used to determine sample size for results to be generalizable

So, is it Still Representative?

Page 26: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Is the Survey Valid & Reliable?

• Modeled on the Behavioural Risk Factor Surveillance System (BRFSS) conducted by the Centres for Disease Control and Prevention (CDC) in Atlanta

• Many questions also taken from the CCHS and the National Population Health Survey (NPHS)

• The original design was tested for reliability and validity

Yes!

Page 27: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

How Do We Ensure Accurate Results?

• Confidence intervals & coefficient of variation

Page 28: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

The Confidence Interval (CI)

• How confident are we in the point estimate (i.e., value)?

• E.g., 6% … (85% CI: 3% - 9%). What does 95% mean?

• … based on probability.

Page 29: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

29

Probability

Page 30: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Probability

Page 31: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

31

Probability

Page 32: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

32

Significance Testing

Statistically Significant

NOT Statistically Significant

What does this have to do with the CI?

• Likely happened• The results are probable

• It could have happened by chance alone

Page 33: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Significance Testing

Your Turn!Please complete section one. Circle statistically significant statements.

• We use the CI to determine whether something is statistically significant.

• If the CIs do not overlap than they are SS

• Example: Percentage of females vs males who smoke:Females: 70% (60%-80%)Males: 30% (20%-40%)

Page 34: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

34

Page 35: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Coefficient of Variation

Your Turn!Please circle the asterisk

in the table.

• Refers to the precision of the estimate

• Usually a result of small numbers (i.e., 2/800)

• Interpret with caution presented with an *asterisk

• An empty cell means the value is not precise(in fact, incorrect), so we cannotreport this number

Page 36: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

36

RRFSS is Self-Reported? Are there limitations to this?

Page 37: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

37

Distorted Perceptions

Page 38: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Distorted Perceptions

Page 39: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Hawthorne Effect

In groups of two, please answer the following …

How many times per day, week or month do you drink 100% fruit juices such as orange, grapefruit, or tomato juice?

How often do YOU wear a seatbelt when YOU DRIVE a car, van or truck: Would you say, all of the time, most of the time, about 1/2 the time, less than 1/2 the time, or never or almost never?

Page 40: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Memory Recall

What is the total amount of time you spent sitting, last Wednesday? (hours & minutes)

Page 41: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Sensitivity

In groups of two, please answer the following …

What is your age?

How much do you weigh?

In your lifetime, have youEver had suicidal thoughts?

What is your yearly totalIncome (before taxes)?

Page 42: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Self-Reported Measures

Page 43: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

43

What RRFSS Recall