evidenced based programs. agenda review of programs in missouri how to select programs of your own
TRANSCRIPT
Evidenced Based Programs
Agenda
Review of Programs in Missouri
How to Select Programs of Your Own
Rigorously Defining EBP Evaluation research shows that the program
produces the expected positive results;
The results can be attributed to the program itself, rather than to other extraneous factors or events;
The evaluation is peer-reviewed by experts in the field;
AND
The program is “endorsed” by a federal agency or respected research organization and included in their list of effective programs.
Practically Defining EBP
Included on Federal Lists or Registries of evidence based interventions (as an effective program);
OR Reported (with positive effects) in peer-
reviewed journals / government publications;
OR Convincing scientific research proving
the intervention’s effectiveness.
WHAT IS GOING ON IN MISSOURI?
Programs Used in Missouri
Regional Support Centers were asked which programs they used
12 total responses, 59 programs
Statewide Programs
Mental Health First Aid
QPR (Question, Persuade, and Refer)
Programs Used in Missouri (>33%)
Evidenced Based Program (EBP) Currently Implementing
Implemented in the Past but not Now
Life Skills Training 33% 42%
All Stars 33% 42%
Strengthening Families Program (SFP) 33% 25%
Project Alert 17% 42%
HALO 33% 8%
Signs of Suicide (SOS) 33% 0%
Peace Builders 17% 8%
Too Good For Drugs and Violence 17% 17%
Guiding Good Choices 8% 42%
Project Towards No Drug Abuse 8% 25%
Love and Logic Olweus BASICS (Brief Alcohol Screening and
Intervention of College Students) Lifelines Project Northland Above the influence
Programs Used in Missouri (<33%)
Al’s Pals Building Strong Families Families and Schools Together (FAST) SMART Moves (Skills Mastery and
Resistance Training) Wyman’s Teen Outreach Program
(TOP) Protecting You / Protecting Me
Programs Used in Missouri (<33%)
ABC’s of Secondhand Smoke Alcohol: True Stories Ask Listen Refer Aggressors, Victims, and Bystanders
(AVB) Big Brothers, Big Sisters Mentoring
Program Communities Mobilizing for Change
on Alcohol
Programs Used in Missouri (1 RSC)
Choose Respect How to Cope (youth & adult versions) Creating Lasting Family Connections
(CLFC) Curriculum-Based Support Group
(CBSG) Good Behavior Game (GBG) Not On Tobacco Parents and the Law
Programs Used in Missouri (1 RSC)
Parents as Teachers Positive Action Project Toward No Tobacco Use Second Step Short, Brief Intervention and Referral
to Treatment (SBIRT) SmokeBusters
Programs Used in Missouri (1 RSC)
Too Smart to Start SISTA The Seven Challenges Why Try
Programs Used in Missouri (1 RSC)
LOOKING AT A FEW EBPsNote: This is a very brief overview of each program designed to illustrate some things to consider. It is not intended to fully describe the program.
If you are considering choosing an EBP, please fully review all literature.
Mental Health First Aid - Design
What is it supposed to do? Potential to reduce stigma, improve mental
health literacy, and empower individuals
Who is the target audience? Friends and family of individuals with mental
illness or addiction, key professionals (such as police officers, human resource directors and primary care workers), school and college leadership, faith communities, or anyone interested in learning more about mental illness and addiction
Mental Health First Aid - Evidence
Research showing: Improved mental health in those who
attend the training Decreases in stigmatising attitudes Increases in the amount and type of
support provided to others
Publication in peer reviewed journals
QPR - Design
What is it supposed to do? Teach "gatekeepers” the warning signs
of a suicide crisis and how to respond by following three steps
Who is the target audience? Parents, friends, neighbors, teachers,
coaches, caseworkers, police officers, etc.
QPR - Evidence
Research showing: Increases in declarative and perceived
knowledge about suicide; maintained at the 3-month follow-up
Higher gatekeeper self-efficacy score Higher knowledge of suicide prevention
resources
Publication in peer reviewed journals
Life Skills - Design
What is it supposed to do? Prevent alcohol, tobacco, and marijuana
use and violence
Who is the target audience? Separate programs offered for
elementary, middle, and high school; the research studies and outcomes reviewed involved middle school students
Life Skills - Evidence
Research showing: Significant decrease in cigarette
smoking, alcohol use (drunkenness), and polydrug use
Lower normative expectations than control students for peer smoking and drinking
Significant reductions in violence and delinquency at 3-month follow-up
Publication in peer reviewed journals
All Stars - Design
What is it supposed to do? Prevent and delay the onset of high-risk
behaviors such as drug use, violence, and premature sexual activity
Who is the target audience? Middle school students (11-14 years old)
All Stars - Evidence
Research showing: Average scores for personal
commitment increased from pre- to posttest
Average scores for lifestyle incongruence increased from pre- to posttest
Average scores for school bonding increased from pre- to posttest
Publication in peer reviewed journals
Strengthening Families - Design
What is it supposed to do? Designed to increase resilience and
reduce risk factors for behavioral, emotional, academic, and social problems in children 3-16 years old
Who is the target audience? Parents & Children
Strengthening Families - Evidence
Research showing: Children who received SFP had lower scores
on conduct disorder symptoms, oppositional defiance symptoms, and behavior problems than children in the control group.
Improvements in positive parenting, parental involvement, parenting skills, parental supervision, and parenting efficacy
Publication in peer reviewed journals
NREPP DEMONSTRATION
Picking Your Own Programs
NREPP
SAMHSA’s tool
Good place to look for Behavioral Health
Not the only list out there!
NREPP Limitations
From NREPP’s website “NREPP ratings do not reflect an
intervention's effectiveness. Users should carefully read the Key Findings sections in the intervention summary to understand the research results for each outcome.”
“Use of NREPP as an exhaustive list of interventions is not appropriate, since NREPP has not reviewed all interventions.”
Not on NREPP!? Next Steps
Do a web search Check for Program Website
Do they claim EBP? How? Do they have positive evaluation results?
May pop up on another list (CDC, Dept of Ed, etc)
Google Scholar for Peer Reviewed Journals
Call Program Developer
Pilot test it yourself (Service to Science)
One Size does NOT Fit All
Targeted towards a particular problem
Targeted towards a particular population
(A cheesy comparison)
Start Small (if you can)
Get 1 copy of all materials to review
Pilot test with 1-2 groups
Fidelity
Programs are EBP based on implementing them as designed
The more modifications made, the less EBP they are
Possibly still effective but no proof Care should be taken when calling it EBP
Contact Information
Susan Depue, Ph.D.Research Assistant ProfessorMissouri Institute of Mental HealthUniversity of Missouri - St. Louis5400 Arsenal St., St. Louis, MO 63139-1403PHONE: (314) 877-5942E-MAIL: [email protected]