how to assess the effectiveness of aca outreach ... outreach and...how to assess the effectiveness...
TRANSCRIPT
![Page 1: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/1.jpg)
How to Assess the Effectiveness of ACA
Outreach & Education Efforts
April 29, 2015
Kien Lee
Vice President
& Principal
Associate, Community
Science
Oscar
Espinosa
Senior
Associate, Community
Science
![Page 2: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/2.jpg)
TODAY’S AGENDA
1. Overview and Context
2. Methods to assess the effectiveness of ACA outreach and education efforts;
3. Results of outreach efforts in terms of reach, knowledge gain, and intent to act;
4. Lessons Learned for overcoming barriers to enrollment, designing effective outreach strategies in future enrollment periods; and, evaluating the impact of ACA outreach.
5. Question & Answer Session
2
![Page 3: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/3.jpg)
o Use the arrow to open and hide your
control panel
o Note that you are all automatically
muted and in listen only mode
o Join audio by:
o Choosing “Mic & Speakers” to
use VoIP
o Choosing “Telephone” and dial
in using the information provided
o Use the “Questions” panel to:
o Troubleshoot tech problems, or
email: [email protected]
o Submit questions and comments
via the “Questions” panel for
Q&A session at the end!
WEBINAR LOGISTICS3
![Page 4: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/4.jpg)
![Page 5: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/5.jpg)
NATIONAL PARTNERSHIP FOR ACTION
TO END HEALTH DISPARITIES
5
![Page 6: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/6.jpg)
INSURANCE ENROLLMENT AS A SHARE (%) OF
POTENTIAL MARKETPLACE POPULATION
Source: Kaiser Family Foundation, February 17, 2015
64%
60%
52%
52%
51%
51%
FLORIDA
MAINE
PENNSYLVANIA
DELAWARE
NORTH CAROLINA
NEW HAMPSHIRE
24%
23%
21%
20%
ALASKA
NORTH DAKOTA
SOUTH DAKOTA
IOWASource: Kaiser Family Foundation, February 17, 2015
Potential market includes legally-residing individuals who are
uninsured or purchase non-group coverage, have incomes
above Medicaid/CHIP eligibility levels, and who do not have
access to employer-sponsored coverage. The estimate
excludes uninsured individuals with incomes below the federal
poverty level who live in states that elected not to expand the
Medicaid program; these individuals are not eligible for
financial assistance and are unlikely to have the resources to
purchase coverage in the Marketplace.
6
![Page 7: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/7.jpg)
TAKE HOME POINT:
EFFECTIVE ACA OUTREACH
CAN MAKE THE DIFFERENCE
7
![Page 8: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/8.jpg)
Measurement Domains
REACH
Outreach Participant Data Source
• Event Size
• Target Pop
• Location Type
• Mode
• Dosage
• Race/ethnicity
• Age
• Gender
• Language
• Tech Literacy
• Event Log
• Assessment
ENGAGEMENT
Outreach Participant Data Source
• % Aware of Language
Access Services
• Cultural Adaptations to
Content
• % Request Language Access
Services
• % Ask Questions
• % Make an Appointment
• Event Log
• Assessment
• Event Organizer Interviews
KNOWLEDGE GAIN
Outreach Participant Data Source
• Topics and Key
Messages
• Retrospective Pretest of Perceived
Knowledge
• Assessment
• Event Organizer Interviews
INTENT TO ACT
Outreach Participant Data Source
• Topics and Key
Messages
• % Likelihood to Enroll, Gather More
Information, Think about Options
• Assessment
• Event Organizer Interviews
8
![Page 9: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/9.jpg)
Knowledge Gain
Reach
Language Help
Tech Literacy
Intent to Enroll
9
![Page 10: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/10.jpg)
QUESTIONNAIRE TRANSLATIONS10
![Page 11: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/11.jpg)
QUESTIONNAIRE ADMINISTRATION
o Local RHEC partner organizations received training and resources to administer assessments.
o Data were collected via paper-and-pencil and online.
o A Quick Response (QR) code and shortened bitly links were available to aid participants in responding online.
11
![Page 12: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/12.jpg)
EVENT ORGANIZER INTERVIEW PROTOCOL
o Identification of Need
oOutreach Event Strategies
oFactors Contributing to Success
o Indicators of Success
oChallenges Experienced by Participants
oChallenges in Recruitment / Publicizing Events
oRecommendations for Future Events’ Success
12
![Page 13: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/13.jpg)
FINDINGS FROM ACA
OUTREACH IN THE FIRST OPEN
ENROLLMENT PERIOD
13
![Page 14: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/14.jpg)
REGIONAL HEALTH EQUITY COUNCILS (RHECS)
ACA OUTREACH & EDUCATION ACTIVITIES
o During the 1st Open Enrollment, assessment data were submitted on 29 outreach activities co-sponsored by:
1. Southeast Health Equity Council (RHEC IV)
2. Great Lakes Regional Health Equity Council (RHEC V)
o The events took place in:
o Michigan (15)
o Ohio (11)
o Tennessee (1 event)
o Georgia (2 events)
o Activities reached 2255 participants and data were received from 819 respondents.
14
![Page 15: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/15.jpg)
REACH
Special PopulationNumber of
Events
Number of
Participants
African American 11 1785
South Asian 2 135
Southeast Asian 2 66
East Asian 5 87
Pan Asian 7 139
Young Invincibles/
Community College1 24
Formerly Incarcerated 1 19
TOTAL 29 2,255
15
![Page 16: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/16.jpg)
Characteristic Number (Percentage)
Race
African American/Black 369 (45.1%)
Caucasian/White 45 (5.5%)
Asian or Pacific Islander 332 (40.5%)
Hispanic or Latino 26 (3.2%)
Native American/Alaska Native 1 (0.1%)
Arab American 4 (0.5%)
Other 17 (2.1%)
Gender
Male 256 (31.3%)
Female 538 (65.7%)
Age
18-34 91 (11.1%)
35-64 549 (67.0%)
65+ 132 (16.1%)
DEMOGRAPHICS 16
![Page 17: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/17.jpg)
PERCEIVED KNOWLEDGE GAIN (N=679)
Ways to
Buy*
Tax
Credits*Benefits*
Types of
Policies*
How It
Works*
Pre 1.62 1.56 1.76 1.63 1.81
Post 2.56 2.50 2.62 2.53 2.60
Difference 0.94 0.94 0.86 0.90 0.79
0.00
0.25
0.50
0.75
1.00
1.25
1.50
1.75
2.00
1.00
1.25
1.50
1.75
2.00
2.25
2.50
2.75
3.00
Pre
an
d P
ost D
iffere
nce
17
![Page 18: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/18.jpg)
INTENT TO ACT FOLLOWING OUTREACHLe
vel of
Inte
nt
2.53
2.39
2.122.04
Do More
Thinking
Gather More
Information
Make an
Appointment
Enroll in Health
Insurance
18
![Page 19: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/19.jpg)
o Enrollment Complexity
o Trust Issues
o Technology Literacy among Older Adults
o Availability and Training of In-Person Assisters
o Health Insurance and Health Care Literacy
LESSONS LEARNED:
OVERCOMING ENROLLMENT BARRIERS
19
![Page 20: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/20.jpg)
20
• Design outreach events by first understanding how community organizational structures impact your credibility.
• How does the community vet outsiders?• What media outlets do they trust and utilize?• What locations do they frequent (e.g., churches,
grocery stores)? What times of day?• What concerns do they have about the
enrollment process?
LESSONS LEARNED:
DESIGNING EFFECTIVE OUTREACH
![Page 21: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/21.jpg)
21
• Develop a measurement framework to operationalize effectiveness.
• Work closely with your event coordinators on event logistics and data collection protocols.
• Customize data collection instruments to the population you are trying to reach (language, reading level).
• Pilot test the data collection instrument.• Build on the resources within your network of partners.• Consider online data collection as an option.
LESSONS LEARNED:
EVALUATING ACA OUTREACH
![Page 22: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/22.jpg)
QUESTION & ANSWER
SESSION
22
![Page 23: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/23.jpg)
THANK YOU!
First Open Enrollment Outreach Partners
o Othelia Pryor, Michigan Minority Health Coalition
o Manju Sankarappa, Ohio Asian American Health Coalition
o Cherry Houston, Critical Learning Systems
o Neicey Johnson, VSNS, Inc.
o Zakiya Sloley, Center for Pan Asian Community Services
23
![Page 24: How to Assess the Effectiveness of ACA Outreach ... Outreach and...How to Assess the Effectiveness of ACA Outreach & Education Efforts April 29, 2015 Kien Lee Vice President & Principal](https://reader034.vdocuments.us/reader034/viewer/2022042417/5f3298498342c74e930d24f6/html5/thumbnails/24.jpg)
QUESTIONS? CONTACT US!
Kien Lee
Vice President & Principal Associate
Community Science
Oscar Espinosa
Senior Associate
Community Science
24