nm community survey

Pacific Institute for Research and Evaluation www.pire.org

NM Community Survey

Data Collection Training

February 9, 2021

1

Photo credit: TruScribe

You are experts in your own communities

Agenda

• Important Dates for your Calendar

• Why We Survey

• Changes to the Survey for FY 21

• Changes to the Data Collection Process for FY21

• Protocol Development

• Budget Reminders from OSAP

• Data Entry and Analysis

• Contact Us3

Important Dates for Your Calendar

February 16- First draft of data collection protocol

due to PIRE

February 17-22 - PIRE internal review of data

collection protocols. PIRE will work with sites

individually to prepare protocol for SEOW review

February 19-25 - SEOW reviews

February 26 - PIRE works with communities to

finalize protocols

March 1- Data collection may begin with approved

protocol and online survey goes live4

Important Dates for Your Calendar

• Mid-March TBD - Data Entry Training

• April 30 - Data collection ends

• May 7 - Data files (for paper surveys) are due

• June 1-15 - PIRE returns aggregated data files to

LEs

• Late June - PIRE returns R-reports (if resources

available)

• July 15 - All EOY reporting documents submitted

to OSAP

5

6

NEW MEXICO COMMUNITY SURVEY (NMCS)

WHY WE SURVEY

What is NMCS?

• Gathers state- and community-level data on ATOD and

prescription drug use

• Evaluates effectiveness of locally implemented

environmental strategies on intervening variables and

outcomes

• FY 2020-11,774 surveys; 75% online

7

How Will the Data be Used?

• Programs and communities to assess local needs and track

changes over time in key prevention areas

• OSAP to track changes in ATOD use & IVs over time at a state

level

• State agencies to improve & increase prevention services to all

New Mexicans

• SEOW (State Epi Outcomes Workgroup) to monitor and track

local progress

• PPC (Statewide Prevention Policy Consortium), & PDO

Advisory Board to encourage alignment of goals among state

agencies

• How do you use the data? 8

The NM Community Survey

• Sample: Adults 18 years and older living in

NM

• Goal = collect reasonably representative

sample of adults in the community

March 1-April 30, 2021 (9 weeks)

9

10

NEW MEXICO COMMUNITY SURVEY (NMCS)

CHANGES TO THE SURVEY FOR FY21

BIG, Ol’,

CAVEAT

11

The NM Community Survey-

Core + 10 Optional Modules

• Core (38)

• adverse childhood

experiences (ACEs)

(12)

• college community (1)

• community alcohol-

related harms (10)

• gambling (5)12

• marijuana (15)

• mental health (12)

• methamphetamine (7)

• additional opioid questions

(9)

• poly-substance use (6 for

PFS-20; 2 for all others)

• tobacco (7)

Changes to NMCS in FY21

Mostly online; online recruitment focus

expanded at state and program levels

• Core

•Mental Health

•Limited changes to Community, Marijuana,

and Meth Modules

•New PFS20 Module

13

The NM Community Survey- Core

• 38 questions (paper/offline Qualtrics

survey)

• Covers the following topics:

– Demographics

– Perception of ATOD within the community

– Alcohol consumption & access

– Prescription painkiller use & access

14

Online survey link = Core + 2 Poly-substance

use (30 day meth and polysub use)

Changes to the Core

Are you?

Do you think of yourself as?

What sex is listed on your original birth

certificate (sex assigned at birth)?

15

Changes to the Core

Do you identify as LGBTQ?

Which of the following best describes how

you think of yourself?

16

Changes to Mental Health

Anxiety

Poor physical or mental health keep you

from doing your usual activities, such as

self-care, work or recreation?

At any time in the past year, did you think

about killing yourself?

2 suicide questions17

Changes to Community Alcohol

Harms Related Module

In your opinion, when is it okay for someone

to provide alcohol to minors (i.e., under 21)

(not for religious purposes)?

Moved from Core to Community Module

18

Changes to Marijuana Module

Have you ever used marijuana?

Have you used marijuana in the past 12

months?

I support local law enforcement actions to

prevent driving under the influence of

marijuana.

19

Changes to Meth Module

Have you ever used methamphetamine?

Have you used methamphetamine in the

past 12 months?

20

Photo credit: Pixabay

Photo credit: Chris Yates

21

Take a Minute…

Questions?

22

NEW MEXICO COMMUNITY SURVEY (NMCS)

CHANGES TO DATA COLLECTION

PROCESS FY21

Data is collected online or in-person

New Mexican residents only

18 or older

1 submission per person

23

Minimum Requirements for In-Person

24

Recruitment Ideas

25

• Visual Media

• Direct Mail

• Social Media

• Partnerships

• Working with Municipalities/Local Systems

You can spend money on these things!

See protocol for full descriptions and

examples!

State-Wide Recruitment Efforts

• PIRE uses social media research and advertising to target

web-savvy participants in your communities.

• PIRE places and monitors Facebook & Instagram ads in

English and Spanish.

• Halfway through, we will begin zipcode targeting in areas

with low response rates

26

State-Wide

Visual Ad

27

Who Needs Posters?

Who needs fliers?

How many?

Write us in the chat!

Example of Social Media Ads

28

Example of a Community Ad

29

Example of a Very Effective Ad

30

Discussion

Photo credit: Burst

32

NEW MEXICO COMMUNITY SURVEY (NMCS)

PROTOCOL DEVELOPMENT

Protocol Overview

• Every community must submit a data collection

protocol to PIRE

• Must be approved prior to collecting any data

33

For those who have conducted the

survey in previous years…

• You must use the FY 21 form. It has changed A

LOT!

34

New to data collection? Welcome!

Email PIRE if you do not have access to your FY20 files.

Data Collection Protocol seeks to

Balance Multiple Needs

• Safe data collection practices

• Seeking “randomness”

• Representative

• Culturally appropriate

• Provides voice to difficult to reach populations

35

Who are You Sampling?

• NM residents

• 18 and over (oversample young adults)

• This includes:

– Spanish & English speaking

– Parents

– Elderly

– Undocumented & non U.S. Citizens

– College students

– All race/ethnicities

– Sexual & gender minorities 36

Choosing Optional Modules

• You may choose to add any of the additional

modules to paper/Qualtrics offline or on-line.

– Remember how much additional questions increase

the time to take the survey, and choose wisely.

• NOTE: You may also add additional questions

pertaining to your evaluation needs*

– Questions must be approved by PIRE/SEOW and

must include a statement that questions are directly

from the provider and not OSAP. (See protocol

document)37

Incentives for Participation

38

To participate in the drawing….

39

Incentives for Online Data Collection

• Online incentives are only available if the

participant takes the survey online

– No connection between your responses and your

information for the drawing.

– Only eligible to win the weekly incentive during the

week you completed the survey.

• Duplicate entries are not allowed. (We

remove duplicate entries from later drawings.)

40

Start Planning Now for Data

Collection

While waiting for feedback on your

protocol, start getting your recruitment into

place.

• You may need to get permission to recruit in many

places

41

Final Words on Data Collection

Protocol

• Remember that if you make a significant

change to your protocol after it has been

approved, such as adding a site or changing

an ad, you must let PIRE know.– PIRE’s IRB requires that we supervise data collection in

this way. If data collection occurs in other ways, it could

inadvertently incur a violation & all data collection must

stop for the entire state

42

Pacific Institute for Research and Evaluation www.pire.org

OSAP Budget Slides 2021

Budgeting for the data collection - from OSAP

• Same Process: Budget form is due Feb 19th

• to OSAP for review and approval

• I will do a walkthrough of those instructions separately from this training

• Any budget modifications must also be approved by OSAP

• Consider how and who completes data collection and data entry

• least expensive options preferable (e.g. volunteers)

• Actual cash incentives over $1 are no longer allowed, as per OSAP

Covid adjustments

• **Gift cards/incentives should be limited to

the number of paper surveys expected

and cannot be used for other coalition

purposes**

• Since Covid is making most of the data

collection online

– recruitment and promotion will be bigger

sections of your budget this year (printing and

media)

– For any in-person paper surveys, think about

An Important Word about Stipends &

Budgets – from OSAP

• Maximum stipend $2.50 gift card this year• Ask for in-kind/ donated/coupon incentives

– Pair with OSAP dollars only if no other options

• Good ballpark for stipends/incentives is $2, less is ideal!

• Focus on your elevator pitch

– On why data/ data collection is important

• Consider other options (e.g. Lottery style, raffle: donated

items/cards, store coupons, etc.)

Stipends (FKA: Incentives)

• You don’t have to provide a gift to participants, but highly recommended:

– Gift cards work great but you must track every bit of money that is given for auditing purposes.

– Water, candy bars, healthy snacks.

– Not substance abuse, mental health, prescription drug, or alcohol related gifts, even if it is promoting the prevention coalition.

– Consider tracking different incentives to study what works best.

• You may not collect any personal or identifying information on respondents

• Can you get donated gifts, e.g., coupons?

47

48

NEW MEXICO COMMUNITY SURVEY (NMCS)

EARLY LOOK AT DATA ENTRY AND ANALYSIS

Data Entry and Analysis

• We will provide a training on data entry in mid-

March only for communities collecting

paper/pencil

• PIRE provides cleaned data file with all your data

combined from the on-line surveys and any that

are gathered in other communities.

• Your local evaluator will help you to create any

graphs or tables and Community Survey Findings

Sheet. 49

Where else can NMCS information be found?

50

51

NEW MEXICO COMMUNITY SURVEY (NMCS)

CONTACT US

If you have questions in the field…

• Dave Currey 919-265-2622

– dcurrey@PIRE.org

• Ashley Simons-Rudolph - 919-622-5220

– asimons-rudolph@pire.org

• Marissa Elias – 575-202-2232

– MElias@PIRE.org

• Kim Zamarin 505-907-0801

– KZamarin@PIRE.org

52