CalMHSA Prevention and Early Intervention (PEI) Program Evaluation
Technical Assistance and Capacity Building
Facilitating Stakeholder Involvement Through Collecting and Reporting Program
Data
KW-2 03/2013
Overview
• Part 1: Tool description and rationale
• Part 2: How to use the tool
• Part 3: Using program data to facilitate stakeholder involvement
KW-3 03/2013
Part 1:
Tool Description and Rationale
KW-4 03/2013
MHSA Requires Counties Prepare a 3-Year Program and Expenditure Plan
• Plan must be developed with “meaningful stakeholder input”
• Clients and families must be involved in all aspects of community planning process
• Plan must be updated annually
KW-5 03/2013
What is “meaningful” stakeholder input?
• “Knowledge is power”
• In order to make informed decisions, stakeholders need accessible information on current program activities
• Making data easy to understand builds confidence
• Important to have an easy way to collect, analyze and present data in a way that facilitates meaningful stakeholder input
KW-6 03/2013
MHSOAC May Require Counties to Report Program Data
Proposed requirements include:
• Types of programs
• Number served and age distribution of participants for each program
• Cost per participant by program
• Other performance outcomes - not yet defined
KW-7 03/2013
County-funded CalMHSA TTACB Supported RAND/SRI Data Collection and Reporting Tool
• Developed tool in 2013 and pilot tested it with counties at TTACB work groups
• Revised tool using feedback from work group participants and experience from TTACB individual technical assistance to counties and programs
• Designed to display data for stakeholders in easy-to-understand format
• Designed to meet current reporting needs established by MHSOAC
KW-8 03/2013
Tool Consists of Three Parts
• Individual PEI Program Description Questionnaire
• All PEI Program Description Workbook
• Stakeholder PEI Presentation PowerPoint Slide Deck
KW-9 03/2013
Part 2: How to Use the tool
KW-10 03/2013
A Three Part Tool to Describe County PEI Programs
1. Individual PEI Program Description Questionnaire– Can be completed by each PEI program– Two formats, “fillable” and paper/pencil
2. All PEI Program Description Excel Workbook– County staff enter data from all programs– Results automatically calculate and create
graphics
3. Stakeholder PEI Presentation PowerPoint Slide Deck– Easily drop graphics into slides for presentations
KW-11 03/2013
Relationship Among Three Parts
Program
2
Program
1
Program
3
Program 6
Program
7
Program 10
All Program Description ExcelWorkbook
StakeholderPresentationsSlide Deck
Individual Program Questionnaire
KW-12 03/2013
Part 1 - Individual Program Description Questionnaire
• Should be filled out individually for each PEI program in the county
• Should probably be completed by program staff, but could be completed by county staff
• Includes instructions and definitions
• Formatted for easy and accurate data entry
• Purpose: Collect accurate data about each PEI program
KW-13 03/2013
Individual Program Description Questionnaire Data Collection Steps
• Fill in Name of County Contact person on the first page of the questionnaires (both versions)
• Distribute the questionnaires to an email mailing list of all county direct service and contract PEI program directors
• Note returns against the mailing list
• After ten days send a reminder to any program directors who have not yet responded
• Continue to log in returns against the original mailing list
• On day 14 send a deadline reminder to any remaining programs that have not responded
KW-14 03/2013
Suggested Request Email for PEI Program Description QuestionnaireDear Program Director
Completion of this questionnaire is being requested from all contract and direct service county PEI programs. The purpose of the questionnaire is to help our county to describe the PEI services it funds. Please complete it within two weeks of receipt date and return it to the contact below:
Name of County Contact:Email Address:Phone Number:
If you have any questions, not addressed below, please reach out to the County Contact person named above. Thank you for your cooperation.
KW-15 03/2013
Questionnaire Instructions
• Should be completed by the program management staff person most familiar with the program
• Provided in two formats—paper and pencil or a fillable form that can be completed online
• Provide your best estimate when precise information to answer the question is not available
• Definitions of program categories and examples are provided on page 7 and 8 of the questionnaire
• Please save a copy of your completed questionnaire for your records
KW-16 03/2013
Overview of Questionnaire Items
1. What is the name of the program you are describing? (Please provide full name and any acronym commonly used)
KW-17 03/2013
2. Is this program primarily focused on:(Please check one box)
1 Prevention, or2 Early intervention, or3 System change efforts
KW-18 03/2013
3. What are the main activities that this program carries out? Many programs do a bit of everything, so try to identify the most important activities for this program, which are directed at the target population for the program. Please refer to Guide below in determining program activities.(Check all that apply)
1 Outreach and public awareness campaigns2 Community strengthening3 Gatekeeper education and training (including program
staff training)4 Counseling and support5 Screening and referral6 System change efforts7 Clinical services for early intervention8 Other – what activity? __________________________
KW-19 03/2013
4. What was the approximate total amount of PEI funding for this program in fiscal year 2012-13? Do not include funding for the program that comes from other sources.
$ ____________
KW-20 03/2013
5. Please indicate as best you can how the total funding was used across the main activities of this program in fiscal year 2012-13. If an activity is not part of this program, leave the line blank.
ACTIVITIES % OF total program FUNDING Outreach and public awareness campaigns %_________Community strengthening %_________Gatekeeper education and training %_________Counseling and support %_________Screening and referral %_________System change efforts %_________Clinical services for early intervention %_________Other – what activity? %_________
100% = TOTAL FUNDING
KW-21 03/2013
6. What is the intensity of this program’s main activities taken as a whole?(Please check one box)
1 Single or light touch activities2 More intensive activities3 Both levels
KW-22 03/2013
Duplicated vs. Unduplicated Counts
22
• Duplicated Count: Refers to a program participant who may be counted more than one time in a grant year. This might occur if a client received multiple services in the same reporting period within one program or across multiple programs
• Unduplicated Count: is one (1) person/client that is counted only once, no matter how many different services the client is receiving during the funding period – could be within or across programs.
KW-23 03/2013
About how many individuals were served by this program in 2012, based on a duplicated and/or unduplicated count? • Duplicated count – individuals may be counted more than one time if
they receive several services within one program within the same reporting period.
• Unduplicated count – individuals are counted only once, no matter how many different services a client is receiving within a program in the same reporting period.
7. Please provide an unduplicated count if possible.
______________ Number of unduplicated individuals
or [ ] Unduplicated count not available
KW-24 03/2013
8. Please provide a duplicated count if available.
______________ Number of duplicated individuals
or [ ] Duplicated count not available
KW-25 03/2013
9. What are the age groups mainly targeted by this program?(Check all that apply)
1 Children – Age 0-152 TAY – Age 16-253 Adults – Age 26-59 4 Seniors – Age 60+5 No main group(s) – targets all ages equally
KW-26 03/2013
10. What are the race/ethnicities mainly targeted by this program?(Check all that apply)
1 Hispanic/Latino2 White3 Black/African American4 Asian5 American Indian, Native American,
Alaskan Native6 Native Hawaiian, Pacific Islander7 Other8 No main group(s) – targets all equally
KW-27 03/2013
11. Are materials and program activities provided in languages other than English?(Please check one box)
1 Yes – most of them2 Yes – some of them3 Materials and activities are
in English only
KW-28 03/2013
12. What special groups are mainly served by this program?(Check all that apply)
1 Veterans2 Military3 Foster care children/youth and/or families4 LBGTQ5 Undocumented immigrants6 Low income, Medicaid eligible7 Underserved8 Program designed to serve everyone, no targeting
of any special group9 Other10 NONE OF THESE
KW-29 03/2013
13. In the design or operations of this program have there been any specific adaptations to make it more culturally appropriate for the target group(s)?(Please check one box)
1 Yes2 No3 Not applicable
KW-30 03/2013
14. We are going to ask about the program and public health goals targeted by this program. Programs may have multiple goals so please try to identify the main goals for the program. What are the main goals for this program? By goals we mean the most immediate intended results of this program. (Check all that apply)
1 Increased knowledge and more supportive attitudes about mental illness2 Decreased risk behaviors and/or increased coping skills3 Decreased distress and/or fewer and less severe symptoms Could also
include preventing crisis situations from escalating4 Improved individual functioning (could be at home, school, and work) and increased resilience and well-being5 Improved family functioning
6 Increased help-seeking and utilization of additional assessment and/or treatment services7 Increased community resiliency, such as improved social climate, reduced stigma and discrimination, and more social supports available in the community8 Improved systems of care which could include more coordinated and culturally responsive services, increased capacity and access, improved policies and protocols for how individuals move between systems (e.g., primary care to specialty care, or juvenile justice to the school system)
KW-31 03/2013
15. Programs may or may not directly target public health goals, but may be intended to contribute to reducing mental health related public health problems. What main public health problems is this program intended to reduce:(Check all that apply)
1 Suicide2 School dropout related to mental health3 Removal of children from the home related to
mental health4 Incarceration related to mental health5 Homelessness related to mental health6 Unemployment related to mental health7 Stigma and discrimination related to mental health8 Prolonged suffering related to mental health9 Disparities related to mental health treatment access
and/or utilization
KW-32 03/2013
16. Are there main program goals that were not covered in these questions?(Please check one box)
1 Yes -> What goals?2 NO, ALL WERE COVERED
KW-33 03/2013
Guide to classifying program activities
OUTREACH AND PUBLIC AWARENESS CAMPAIGNS
Purpose: To increase public knowledge and awareness.
Target: General public - individuals not identified on the basis of a specific risk factor.
Examples: Public service announcements; developing and hosting informational websites; creating and distributing pamphlets or other printed material for wide scale distribution; stigma reduction campaigns; hosting health fairs.
Note: Do not include outreach intended to recruit program participants or build community partnerships in this category.
KW-34 03/2013
Guide to classifying program activities
COMMUNITY STRENGTHENING
Purpose: To increase community resources and resiliency, or to improve social climate and increase social support.
Target: These are universal prevention activities and are not directed towards individuals who have specific risk factors.
Examples: A resource or drop in center (if the primary purpose of the resource program is community strengthening); a school-based anti-bullying program directed at the entire school or community; an exercise program for the elderly; NAMI Family to Family programs and vocational programs; Parent education programs for all parents; school readiness programs that are targeted at all children.
KW-35 03/2013
Guide to classifying program activities
GATEKEEPER EDUCATION AND TRAINING
Purpose: To train and educate individuals to recognize someone who is in distress and could benefit from further evaluation or treatment and/or to create a safe and non-stigmatizing environment where someone can self-identify as needing help.
Target: Community leaders, school personnel, emergency workers, and other gatekeepers.
Examples: Teacher training programs, training for suicide hotline operators, training for outreach workers and community leaders.
Note: This category includes training of program staff.
KW-36 03/2013
Guide to classifying program activities
COUNSELING AND SUPPORT
Purpose: To reduce risk factors and increase coping skills.
Target: At-risk individuals, rather than individuals with a known diagnosis. These programs do not include universal prevention programs.
Examples: Peer support programs; Resource centers (if the primary purpose is to provide counseling and support); Suicide hot and warm lines; Parent training programs for children with identified needs or risk factors; Violence prevention programs directed at selected children or youth; Promotoras home visiting programs.
Note: These activities are generally conducted by individuals who are not licensed mental health clinicians.
KW-37 03/2013
Guide to classifying program activities
SCREENING AND REFERRAL
Purpose: To identify individuals who might benefit from additional assessment and/or counseling.
Target: At risk individuals such as foster youth, new moms, frail elderly.
Examples: School-based screening; suicide hot and warm lines, some Promotoras programs.
KW-38 03/2013
Guide to classifying program activities
SYSTEM CHANGE EFFORTS
Purpose: To improve system functioning in order to increase appropriate identification of need and access to services.
Target: Public and private systems.
Examples: Efforts to develop and disseminate culturally appropriate policies and procedures and culturally competent services, as well as data systems to track individuals. Development of referral networks and efforts to increase and make more efficient collaboration across systems and programs. Efforts to increase access and capacity by reducing inefficiencies could also be included here.
KW-39 03/2013
Guide to classifying program activities
CLINICAL SERVICES FOR EARLY INTERVENTION
Purpose: To keep mental illnesses from becoming chronic and increasing in severity.
Target: Individuals with either a known or likely diagnosis or symptoms related to a diagnosis.
Examples: First break psychosis programs, PTSD/PTSD symptom treatment programs; primary care integration programs; school-based trauma treatment; family therapy.
Note: These activities are generally conducted by licensed mental health clinicians.
KW-40 03/2013
Part 3: Using Program Data to Facilitate Stakeholder Involvement
KW-41 03/2013
All Program Description Excel Workbook
• Example worksheets (labeled EX_Entry on the tabs) show how the Excel worksheets should be completed for the questionnaire items shown on the tabs
• EX_Outputs shows example tables and graphics calculated from the data
• Using the three sheets labeled AC_Entry, use one row for each program to enter the responses to the Individual PEI Program Questionnaire (make sure the program number is same on all sheets)
• Check that all entries are accurate
• Excel automatically calculates summary statistics and produces the tables and graphics on AC_Outputs_Sheet
• Purpose: Enter the responses received on the Individual PEI Program Description Questionnaires and create graphics
KW-42 03/2013
PLEASE REFERENCE “THE ALL PROGRAM DESCRIPTION
EXCEL WORKBOOK “IN THE DOCUMENTS LIST
AT THIS TIME
KW-43 03/2013
Stakeholder Presentation Slide Deck
• The PowerPoint slide deck contains charts that can be populated using the All Program PEI Description Excel Workbook worksheet labeled AC_Outputs_Sheet
• Begin by saving a copy of the Slide Deck with the title of your upcoming presentation
• You can select some or all of the Excel graphics depending on your audience and purpose
• Simply click on a graphic chart in the AC_Outputs_Sheet tab of the Excel Workbook, copy it and paste it into the PowerPoint slide with the same title
- Use the “destination theme” Paste function
Purpose: Share descriptions of PEI programs with stakeholders
KW-44 03/2013
Workbook Creates Graphics for Slides
• As program data are entered the workbook will automatically generate graphics
• Graphics can be “dropped into” slide deck for presentations to stakeholders
• Slides summarize the data provided by individual programs into an easily understandable format
• Program information will help stakeholders provide meaningful input into the decision-making process
KW-45 03/2013
Example Charts for “Golden County”
• List of programs and characteristics– Cost– Count of participants– Intensity
• What activities programs are doing and distribution of dollars across activities
• Target participant characteristics
• Short term goals
• Public health goals
KW-46 03/2013
List of Programs and Characteristics
Program Name Dollars Devoted Duplicated Individuals Count Program Intensity Description
Example Program 1 $4,400,400
PreventionExample Program 2 $58,000 150
Systems ChangeExample Program 3 $3,000,000 400
Early InterventionExample Program 4 $250,000 600
Systems ChangeExample Program 5 $100,000 1,000
Early InterventionExample Program 6 $750,000 2,000
PreventionExample Program 7 $40,000
PreventionExample Program 8 $200,000 600
Early InterventionExample Program 9 $1,500,000 300
PreventionExample Program 10 $150,000 200
Early Intervention
Program Name Dollars Devoted Duplicated Individuals Count Program Intensity Description
KW-47 03/2013
Distribution of Programs by Primary Focus
Prevention; 4; 40%
Early Intervention; 4; 40%
System Change Efforts; 2; 20%
Number of Programs by Primary Focus
PreventionEarly InterventionSystem Change Efforts
KW-48 03/2013
• Outreach and public awareness campaigns
• Community strengthening
• Gatekeeper education and training
• Counseling and support
• Screening and referral
• System change efforts
• Clinical services for early intervention
Types of Activity
KW-49 03/2013
How Many Programs are Doing Each Type of Activity?
Outrea
ch an
d pub
lic aw
arene
ss
Commun
ity st
rength
ening
Gateke
eper
educ
ation
and t
rainin
g
Couns
eling
and s
uppo
rt
Screen
ing an
d refe
rral
System
chan
ge ef
forts
Clinica
l serv
ices f
or ea
rly in
terve
ntion
Other
0
1
2
3
4
5
6
Number of Programs by Activity
Number of Programs
KW-50 03/2013
How are PEI Funds Distributed Across Activities?
Outreach and public awareness; 2657200;
25%
Community strengthening; 1615000; 15%
Gatekeeper ed-ucation and
training; 82000; 1%
Counseling and support; 2407100;
23%
Screening and re-ferral; 470000; 4%
System change efforts; 1525060; 15%
Clinical services for early intervention;
840000; 8%
Other; 852040; 8%
Total Dollars by Activity
Outreach and public awarenessCommunity strengtheningGatekeeper education and trainingCounseling and supportScreening and referralSystem change effortsClinical services for early interventionOther
$10,448,400
TOTAL -
KW-51 03/2013
How Intensive are Programs?
Single or light touch activities More intensive activities Both levels0
1
2
3
4
5
6
Number of Programs by Intensity Level
# Programs
KW-52 03/2013
• Race/Ethnicity
• Primary Language
• Age groups (children, school-age, TAY, adults, seniors)
• Gender
• Special populations– Veterans, military– Foster care, undocumented, undeserved– Low income, Medicaid eligible– LGBTQ
Demographics of Participants
KW-53 03/2013
How many programs mainly target each racial/ethnic group?
Hispan
ic/La
tino
White
Black/A
frican
-Ameri
can
Asian
America
n Ind
ian…
Native
Haw
aiian
…Othe
r
No Main
Grou
p0
1
2
3
4
5
6
Number of Programs by Race/Ethnicities
# Programs
KW-54 03/2013
How many programs mainly target each age group?
Age 0-15 Age 16-25 Age 26-59 Age 60+ No Main Group - targets all ages equally
0
1
2
3
4
5
6
7Number of Programs by Age Groups Targeted
# Programs
KW-55 03/2013
How Many Programs Target Special or Underserved Groups?
Veterans Military Foster care youth LBGTQ Undocumented Underserved Low income Everyone Other0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
Number of Programs by Special Group Served
# Programs
KW-56 03/2013
How Many Programs Mainly Address Each Short-Term Goal?
Increased knowledge and more supportive attitudes about mental illness
Decreased risk behaviors and/or increased coping skills
Decreased distress and/or fewer and less severe symptoms
Improved individual functioning
Improved family functioning
Increased help-seeking and utilization of assessment/treatment services
Increased community resiliency
Improved systems of care
0 1 2 3 4 5 6
Number of Programs by Main Goal
# Programs
KW-57 03/2013
How Many Programs Seek to Reduce Each Public Health Problem?Number of Programs by
Primary Focus
Suicide
School drop-out
Removal of children from home
Incarceration
Homelessness
Unemployment
Stigma and discrimination
Prolonged suffering
Disparities related to treatment
0 1 2 3 4 5 6 7 8 9 10
Number of Programs by Public Health Goal
# Programs
KW-58 03/2013
Using Program Data to Facilitate Stakeholder Involvement—Sample Questions
• Do our current PEI programs and activities address local priorities? What local priorities are not being met? Are there areas that are getting too much attention?
• Do the types of programs reflect our community values? Do the programs promote access and acceptance for the diverse people of California?
• Is this the right allocation of our budget across programs and activities?
• Do we have the right distribution of programs between Prevention and Early Intervention?
• Do our programs link people with early onset of serious mental illness with medically necessary care provided by county mental health programs? Are we doing enough outreach to potential responders to help them identify early signs of potentially severe mental illnesses?
• Are we meeting the needs of different underserved populations and age groups?
• Are there public health goals we are not addressing that we should?
KW-59 03/2013
BEGINNING BLANK PRESENTATION SLIDE DECK
Golden County PEI Programs Overview and Description
Presentation to GROUP
DATE
KW-61 03/2013
Goals
• Do our current PEI programs and activities address local priorities? What local priorities are not being met? Are there areas that are getting too much attention?
• Do the types of programs reflect our community values? Do the programs promote access and acceptance for the diverse people of California?
• Is this the right allocation of our budget across programs and activities?
• Do we have the right distribution of programs between Prevention and Early Intervention?
• Do our programs link people with early onset of serious mental illness with medically necessary care provided by county mental health programs? Are we doing enough outreach to potential responders to help them identify early signs of potentially severe mental illnesses?
• Are we meeting the needs of different underserved populations and age groups?
• Are there public health goals we are not addressing that we should?
KW-62 03/2013
Overview
• Background
• Golden County PEI Programs Description
• Stakeholder feedback and discussion
KW-63 03/2013
MHSA Requires Counties Prepare a 3-Year Program and Expenditure Plan
• Plan must be developed with “meaningful stakeholder input”
• Clients and families must be involved in all aspects of community planning process
• Plan must be updated annually
• “Knowledge is power”
KW-64 03/2013
How We Collected Program Information
Program
2
Program
1
Program
3
Program 6
Program
7
Program 10
All Program Description ExcelWorkbook
StakeholderPresentationsSlide Deck
Individual Program Questionnaire
KW-65 03/2013
Individual Program Description Questionnaire
• Filled out individually for each PEI program in the county
• Purpose: Collect accurate data about each PEI program
KW-66 03/2013
Golden County PEI Programs –What Information We Will Provide
• List of programs and characteristics– Cost– Count of participants– Intensity
• What activities programs are doing and distribution of dollars across activities
• Target participant characteristics
• Short term goals
• Public health goals
KW-67 03/2013
List of Programs and Characteristics
KW-68 03/2013
Distribution of Programs by Primary Focus
KW-69 03/2013
• Outreach and public awareness campaigns
• Community strengthening
• Gatekeeper education and training
• Counseling and support
• Screening and referral
• System change efforts
• Clinical services for early intervention
Types of Activity
KW-70 03/2013
How Many Programs are Doing Each Type of Activity?
KW-71 03/2013
How are PEI Funds Distributed Across Activities?
KW-72 03/2013
How Intensive are Programs?
KW-73 03/2013
• Race/Ethnicity
• Primary Language
• Age groups (children, school-age, TAY, adults, seniors)
• Gender
• Special populations– Veterans, military– Foster care, undocumented, undeserved– Low income, Medicaid eligible– LGBTQ
Demographics of Participants
KW-74 03/2013
How many programs mainly target each racial/ethnic group?
KW-75 03/2013
How many programs mainly target each age group?
KW-76 03/2013
How Many Programs Target Special or Underserved Groups?
KW-77 03/2013
Are Materials and Program Activities Provided in Languages Other than English?
KW-78 03/2013
How Many Programs Mainly Address Each Short-Term Goal?
KW-79 03/2013
How Many Programs Seek to Reduce Each Public Health Problem?
KW-80 03/2013
Questions for Stakeholders
• Do our current PEI programs and activities address local priorities? What local priorities are not being met? Are there areas that are getting too much attention?
• Do the types of programs reflect our community values? Do the programs promote access and acceptance for the diverse people of California?
• Is this the right allocation of our budget across programs and activities?
• Do we have the right distribution of programs between Prevention and Early Intervention?
• Do our programs link people with early onset of serious mental illness with medically necessary care provided by county mental health programs? Are we doing enough outreach to potential responders to help them identify early signs of potentially severe mental illnesses?
• Are we meeting the needs of different underserved populations and age groups?
• Are there public health goals we are not addressing that we should?
KW-81 03/2013
Back-Up SlidesCan Be Used If More Detail Is
Required
KW-82 03/2013
Overview of Questionnaire Items
1. What is the name of the program you are describing? (Please provide full name and any acronym commonly used)
KW-83 03/2013
2. Is this program primarily focused on:(Please check one box)
1 Prevention, or2 Early intervention, or3 System change efforts
KW-84 03/2013
3. What are the main activities that this program carries out? Many programs do a bit of everything, so try to identify the most important activities for this program, which are directed at the target population for the program. Please refer to Guide below in determining program activities.(Check all that apply)
1 Outreach and public awareness campaigns2 Community strengthening3 Gatekeeper education and training (including program
staff training)4 Counseling and support5 Screening and referral6 System change efforts7 Clinical services for early intervention8 Other – what activity? __________________________
KW-85 03/2013
4. What was the approximate total amount of PEI funding for this program in fiscal year 2012-13? Do not include funding for the program that comes from other sources.
$ ____________
KW-86 03/2013
5. Please indicate as best you can how the total funding was used across the main activities of this program in fiscal year 2012-13. If an activity is not part of this program, leave the line blank.
ACTIVITIES % OF total program FUNDING Outreach and public awareness campaigns %_________Community strengthening %_________Gatekeeper education and training %_________Counseling and support %_________Screening and referral %_________System change efforts %_________Clinical services for early intervention %_________Other – what activity? %_________
100% = TOTAL FUNDING
KW-87 03/2013
6. What is the intensity of this program’s main activities taken as a whole?(Please check one box)
1 Single or light touch activities2 More intensive activities3 Both levels
KW-88 03/2013
About how many individuals were served by this program in 2012, based on a duplicated and/or unduplicated count? • Duplicated count – individuals may be counted more than one time if
they receive several services within one program within the same reporting period.
• Unduplicated count – individuals are counted only once, no matter how many different services a client is receiving within a program in the same reporting period.
7. Please provide an unduplicated count if possible.
______________ Number of unduplicated individuals
or [ ] Unduplicated count not available
KW-89 03/2013
8. Please provide a duplicated count if available.
______________ Number of duplicated individuals
or [ ] Duplicated count not available
KW-90 03/2013
9. What are the age groups mainly targeted by this program?(Check all that apply)
1 Children – Age 0-152 TAY – Age 16-253 Adults – Age 26-59 4 Seniors – Age 60+5 No main group(s) – targets all ages equally
KW-91 03/2013
10. What are the race/ethnicities mainly targeted by this program?(Check all that apply)
1 Hispanic/Latino2 White3 Black/African American4 Asian5 American Indian, Native American, Alaskan Native6 Native Hawaiian, Pacific Islander7 Other8 No main group(s) – targets all equally
KW-92 03/2013
11. Are materials and program activities provided in languages other than English?(Please check one box)
1 Yes – most of them2 Yes – some of them3 Materials and activities are
in English only
KW-93 03/2013
12. What special groups are mainly served by this program?(Check all that apply)
1 Veterans2 Military3 Foster care children/youth and/or families4 LBGTQ5 Undocumented immigrants6 Low income, Medicaid eligible7 Underserved8 Program designed to serve everyone, no targeting of
any special group9 Other10 NONE OF THESE
KW-94 03/2013
13. In the design or operations of this program have there been any specific adaptations to make it more culturally appropriate for the target group(s)?(Please check one box)
1 Yes2 No3 Not applicable
KW-95 03/2013
14. We are going to ask about the program and public health goals targeted by this program. Programs may have multiple goals so please try to identify the main goals for the program. What are the main goals for this program? By goals we mean the most immediate intended results of this program. (Check all that apply)
1 Increased knowledge and more supportive attitudes about mental illness2 Decreased risk behaviors and/or increased coping skills3 Decreased distress and/or fewer and less severe symptoms Could also
include preventing crisis situations from escalating4 Improved individual functioning (could be at home, school, and work) and increased resilience and well-being5 Improved family functioning
6 Increased help-seeking and utilization of additional assessment and/or treatment services7 Increased community resiliency, such as improved social climate, reduced stigma and discrimination, and more social supports available in the community8 Improved systems of care which could include more coordinated and culturally responsive services, increased capacity and access, improved policies and protocols for how individuals move between systems (e.g., primary care to specialty care, or juvenile justice to the school system)
KW-96 03/2013
15. Programs may or may not directly target public health goals, but may be intended to contribute to reducing mental health related public health problems. What main public health problems is this program intended to reduce:(Check all that apply)
1 Suicide2 School dropout related to mental health3 Removal of children from the home related to
mental health4 Incarceration related to mental health5 Homelessness related to mental health6 Unemployment related to mental health7 Stigma and discrimination related to mental health8 Prolonged suffering related to mental health9 Disparities related to mental health treatment access
and/or utilization
KW-97 03/2013
16. Are there main program goals that were not covered in these questions?(Please check one box)
1 Yes -> What goals?2 NO, ALL WERE COVERED
KW-98 03/2013
Guide to classifying program activities
OUTREACH AND PUBLIC AWARENESS CAMPAIGNS
Purpose: To increase public knowledge and awareness.
Target: General public - individuals not identified on the basis of a specific risk factor.
Examples: Public service announcements; developing and hosting informational websites; creating and distributing pamphlets or other printed material for wide scale distribution; stigma reduction campaigns; hosting health fairs.
Note: Do not include outreach intended to recruit program participants or build community partnerships in this category.
KW-99 03/2013
Guide to classifying program activities
COMMUNITY STRENGTHENING
Purpose: To increase community resources and resiliency, or to improve social climate and increase social support.
Target: These are universal prevention activities and are not directed towards individuals who have specific risk factors.
Examples: A resource or drop in center (if the primary purpose of the resource program is community strengthening); a school-based anti-bullying program directed at the entire school or community; an exercise program for the elderly; NAMI Family to Family programs and vocational programs; Parent education programs for all parents; school readiness programs that are targeted at all children.
KW-100 03/2013
Guide to classifying program activities
GATEKEEPER EDUCATION AND TRAINING
Purpose: To train and educate individuals to recognize someone who is in distress and could benefit from further evaluation or treatment and/or to create a safe and non-stigmatizing environment where someone can self-identify as needing help.
Target: Community leaders, school personnel, emergency workers, and other gatekeepers.
Examples: Teacher training programs, training for suicide hotline operators, training for outreach workers and community leaders.
Note: This category includes training of program staff.
KW-101 03/2013
Guide to classifying program activities
COUNSELING AND SUPPORT
Purpose: To reduce risk factors and increase copies skills.
Target: At-risk individuals, rather than individuals with a known diagnosis. These programs do not include universal prevention programs.
Examples: Peer support programs; Resource centers (if the primary purpose is to provide counseling and support); Suicide hot and warm lines; Parent training programs for children with identified needs or risk factors; Violence prevention programs directed at selected children or youth; Promotoras home visiting programs.
Note: These activities are generally conducted by individuals who are not licensed mental health clinicians.
KW-102 03/2013
Guide to classifying program activities
SCREENING AND REFERRAL
Purpose: To identify individuals who might benefit from additional assessment and/or counseling.
Target: At risk individuals such as foster youth, new moms, frail elderly.
Examples: School-based screening; suicide hot and warm lines, some Promotoras programs.
KW-103 03/2013
Guide to classifying program activities
SYSTEM CHANGE EFFORTS
Purpose: To improve system functioning in order to increase appropriate identification of need and access to services.
Target: Public and private systems.
Examples: Efforts to develop and disseminate culturally appropriate policies and procedures and culturally competent services, as well as data systems to track individuals. Development of referral networks and efforts to increase and make more efficient collaboration across systems and programs. Efforts to increase access and capacity by reducing inefficiencies could also be included here.
KW-104 03/2013
Guide to classifying program activities
CLINICAL SERVICES FOR EARLY INTERVENTION
Purpose: To keep mental illnesses from becoming chronic and increasing in severity.
Target: Individuals with either a known or likely diagnosis or symptoms related to a diagnosis.
Examples: First break psychosis programs, PTSD/PTSD symptom treatment programs; primary care integration programs; school-based trauma treatment; family therapy.
Note: These activities are generally conducted by licensed mental health clinicians.
KW-105 03/2013
Duplicated vs. Unduplicated Counts
105
• Duplicated Count: Refers to a program participant who may be counted more than one time in a grant year. This might occur if a client received multiple services in the same reporting period within one program or across multiple programs
• Unduplicated Count: is one (1) person/client that is counted only once, no matter how many different services the client is receiving during the funding period – could be within or across programs.
• Can we get unduplicated counts?– Within individual PEI programs?– Across PEI programs in a county?
KW-106 03/2013
• Enroll participants and assign program IDs– Use an online system to support unique records– Create prepopulated service forms with client name and ID for
providers
• Train providers in the importance and methods for enrolling and tracking services
• Have programs submit data on individuals (without personal identifiers) for more meaningful analyses
• Or – agree that unduplicated counts are OK, but be consistent and clear
Methods for Capturing Unduplicated Counts
KW-107 03/2013
How We Handle Counts
• Collected “duplicated” counts for all programs– This is most common form of information counties have
• Graphic displays based on “duplicated” counts since most programs can provide this information
THANK YOU FOR PARTICIPATING