this project was supported by award no. 2014-vf-gx-0001, awarded by the national institute of...
TRANSCRIPT
OVC Vision 21:Linking Systems of Care for
Children and Youth State Demonstration Project
National Evaluation DesignJuly 9, 2015
This project was supported by Award No. 2014-VF-GX-0001, awarded by the National Institute of Justice, Office of Justice Programs, U.S. Department of Justice. The opinions, findings, and conclusions or recommendations expressed in this exhibition are those of the authors and do not necessarily reflect those of the Department of Justice.
OVC welcome NIJ introduction Project roles Overview of the national evaluation Project logic model Data collection approach and components of the
national evaluation
Agenda
OVC Welcome
Research, development, and evaluation arm of USDOJ
NIJ is dedicated to:• Improving knowledge and understanding of crime and
justice issues through science• Providing objective and independent knowledge and
tools to reduce crime and promote justice, particularly at the state and local level
Children exposed to violence work:• Portfolio of individual research projects• Collaboration with OVC and other OJP partners to
evaluate large initiatives such as this one
National Institute of Justice (NIJ)
OVC provided funds to NIJ to manage a national evaluation
Through a competitive solicitation, ICF, International was selected to conduct this study
NIJ hopes to apply lessons learned from similar projects:• OVC-funded wraparound legal services for adult crime
victims • OJJDP-funded Defending Childhood demonstration
sites to prevent and ameliorate children’s exposure to violence
NIJ continued
Demonstration Sites
Vision 21: Linking Systems of Care Demonstration ProjectOrganizational Chart
Office for Victimsof Crime
National Institute of Justice
U.S. Department of Justice,Office of Justice Programs
NCJFCJ TTA
Leadership Team
Training and Technical Assistance National Evaluation
ICF Leadership
Team
ICF Research
Team
Steering Committee
TTA Site Teams1
ICF Site Liaisons
Montana Board of Crime
Control
Virginia Department of
Social Services
Children’s Systems of Care
Planning Committee
Partner Agencies Team
1 Each TTA Site Team consists of 2 permanent members, including a TTA Lead from NCJFCJ and a TTA Provider from NCCTS. Members from the Steering Committee may also provide TTA, as needed. 2 The University of Montana is assisting the Montana site by identifying screening tools.
University of Montana2
VA Dept. of Criminal Justice
Services3
Stakeholder Partners
Advisory Panel
3 While the Virginia Department of Social Services (DSS) is the grantee, both the DSS and the Virginia Department of Criminal Justice Services (DCJS) co-lead the Partner Agencies Team (PAT). Additional stakeholder partners are also incorporated into the system of care network.
Funded by the National Institute of Justice
Purpose:-To provide useful information back to the grantees and OVC to inform implementation
-To provide information to the field for others wanting to address and respond to child victimization in their own communities
-To learn how SOC approaches may lead to better outcomes for child and youth victims
Structure:
-15 month Phase I
- 5 year Phase II
8
National Evaluation- Overview
Co-Principal Investigators: Sara Debus-Sherrill & Mary Spooner
Montana liaison: Melanie JohnsonVirginia liaison: Janine Crossman
Research team of data collection experts and analysts + Advisory Panel
9
National Evaluation- The Team
10
Topic here
11
Data Collection Approach
Questions about logic model?
12
13
Data Collection Approach
Review of Materials (e.g., proposals, project newsletters)
Interviews
• Initial phone interview with grantees
• Site visit interviews with grantees and their partners
Observations
• Project meetings
• Service delivery
Monthly Update Calls
National Evaluation Components
14
Network Partner Survey
• Purpose: collect information about how partnerships operate and extent of service coordination between partners
• Online survey
• Administered yearly each summer of project
• Survey all organizations directly involved with project
• Track changes over time
National Evaluation Components
15
Service Provider Survey
• Purpose: collect information from wide range of front-line, direct service delivery staff to understand their perceptions of services for child and youth victims
• Online survey
• Administered in two waves
Baseline/Pre-implementation
Mature implementation
• Survey front-line, direct service delivery staff in eligible organizations across the state
• Measures changes in services due to implementation of systems of care framework (from service provider perspective)
National Evaluation Components
16
Data Collection from Child/Youth Victim and/or their Families
• Purpose: collect information from victim perspective to understand their perceptions of services
• TBD mode- survey vs. interviews
• TBD timing- most likely administered in two waves
Baseline/Pre-implementation
Mature implementation
• TBD how to recruit participants
• Measures changes in services due to implementation of systems of care framework (from victim perspective)
National Evaluation Components
17
Administrative Data
• Purpose: provide objective measures of services beyond perceptual or self-reported data
• TBD process
• TBD- probably ongoing collection
Time series approach
• Measures changes in services across course of projects and provides information between two time points of service provider/victim components
National Evaluation Components
18
Training and Technical Assistance Assessment
• Purpose: provide ongoing feedback on the TTA delivered to the demonstration sites by NCJFCJ and their partners
• Online survey
• Administered quarterly
• Survey all individuals who have received TTA in the previous quarter
• Assesses how resources such as the TTA Provider help to support the demonstration as a whole
National Evaluation Components
19
20
Data Collection Approach
Reviewing information from materials & interviews Continued participation in monthly calls Network Partner Survey (July) TTA Feedback Survey (July) Data Availability Survey (August) Site visits (TBD- Fall/Winter) Baseline data collection of state service providers
and victims/families of victims (TBD)
Upcoming
Questions?
22
