planning for success: using implementation data to action plan for full and sustained implementation...
TRANSCRIPT
![Page 1: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/1.jpg)
Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation
Barbara Sims
Caryn Ward
National SISEP Center
National Implementation Research Network
Frank Porter Graham Child Development Institute
University of North Carolina at Chapel Hill
![Page 2: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/2.jpg)
Implementation Quick Start
![Page 3: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/3.jpg)
Formula for Success
![Page 4: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/4.jpg)
Formula for Success (continued)
![Page 5: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/5.jpg)
IMPLEMENTATION TEAMS
Organized, expert assistance to develop and sustain an accountable and effective structure
![Page 6: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/6.jpg)
Linked Team StructuresImplementation Teams
![Page 7: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/7.jpg)
Cascading ModelQualityInstruction
Student Outcomes
Implementation Team Supports
QualityInstruction
School Leadership
Implementation Team Supports
EnablingDistrictContext
School Leadership
Enabling State
Context
Enabling District Context
![Page 8: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/8.jpg)
StudentsCascading Logic Model
SISEP Assessments
Population Intervention Strategies(WHAT)
Intervention Outcomes
Students Educators skillfully implement evidence-based intervention strategies.
Socially significant improvements in academic, social, emotional or behavioral outcomes for students.
![Page 9: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/9.jpg)
EducatorsCascading Logic Model
SISEP Assessments
Population Intervention Strategies(WHAT)
Intervention Outcomes
Students Educators skillfully implement evidence-based intervention strategies.
Socially significant improvements in academic, social, emotional or behavioral outcomes for students.
Population Implementation Strategies(HOW)
Implementation Outcomes
Educators Provision of skillful, timely training, coaching, and performance assessments in supportive administrative environments organized by building and district leadership
Educators skillfully implement evidence-based intervention strategies.
![Page 10: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/10.jpg)
Cascading Logic Model
Population Intervention Strategies(WHAT)
Intervention Outcomes
Students Educators skillfully implement evidence-based intervention strategies.
Socially significant improvements in academic, social, emotional or behavioral outcomes for students.
Population Implementation Strategies(HOW)
Implementation Outcomes
Educators Provision of skillful, timely training, coaching, and performance assessments in supportive administrative environments organized by building and district leadership
Educators skillfully implement evidence-based intervention strategies.
Schools and Districts
Systemic professional development leadership and planning to ensure high quality, consistent training and coaching through the use of fidelity and outcome data, and the development of facilitative administrative practices and policies to support implementation
Provision of skillful, timely training, coaching, and performance assessments in supportive administrative environments organized by building and district leadership
![Page 11: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/11.jpg)
Schools, Districts, Regions and States Cascading Logic Models
Population Implementation Strategies(HOW)
Implementation Outcomes
Schools and Districts
Systemic professional development leadership and planning to ensurSce high quality, consistent training and coaching through the use of fidelity and outcome data, and the development of facilitative administrative practices and policies to support implementation
Provision of skillful, timely training, coaching, and performance assessments in supportive administrative environments organized by building and district leadership
Regions and States
Common mission for professional development Formal structures created to build policy–practice feedback loops Review of funding streams to support new functions and relationships Collaborative partnerships to build professional development system infrastructureFidelity and outcome data systems developed and maintained
Systemic professional development leadership and planning to ensure high quality, consistent training and coaching through the use of fidelity and outcome data, and the development of facilitative administrative practices and policies to support implementation
![Page 12: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/12.jpg)
SISEP Center Logic Model
Population Implementation Strategies(HOW)
Implementation Outcomes
Regions and States
Common mission for professional development Formal structures created to build policy–practice feedback loops Review of funding streams to support new functions and relationships Collaborative partnerships to build professional development system infrastructureFidelity and outcome data systems developed and maintained
Systemic professional development leadership and planning to ensure high quality, consistent training and coaching through the use of fidelity and outcome data, and the development of facilitative administrative practices and policies to support implementation
SISEP Center
Increase knowledge of evidence-based implementation supports for evidence-based practices in SEAs, LEAs and TA CentersProvide resources and TA to establish implementation infrastructures in SEAs and LEAs Provide resources and assessment tools to measure fidelity and implementation outcomes
Common mission for professional development Formal structures created to build policy–practice feedback loops Review of funding streams to support new functions and relationships Collaborative partnerships to build professional development system infrastructureFidelity and outcome data systems developed and maintained
![Page 13: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/13.jpg)
Try It Now!
Monitoring Implementation
Progress
Assessing Implementation
Identify 2-3 indicators to help monitor the work of these teams
![Page 14: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/14.jpg)
Tools and Assessments
![Page 15: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/15.jpg)
State Capacity Assessment (SCA)
Purpose: Measure of state and regional capacity for
implementation of evidence-based practices and other effective innovations
Provides a structured process for the development of a State Capacity Action Plan
Administration: Completed by State Management
Team/Implementation Team 2x a year
![Page 16: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/16.jpg)
SCA Scoring key
All Scaling Capacity Items scored using the following format.
Fully In Place 2 points - All dimensions of element adhered to and evidence available to support this rating
Partially In Place 1 point - Some dimensions of element adhered to and/or some dimensions attended to- Action Planning occurs with these elements
Not in Place 0 points - Element not adhered to - Action Planning occurs with these
elements or teams may not be developmentally ready to implement this component
![Page 17: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/17.jpg)
State Capacity Assessment: SMT Section
![Page 18: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/18.jpg)
SISEP.Org
![Page 19: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/19.jpg)
SCA Results: Total Score
![Page 20: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/20.jpg)
SCA Results: SubScale
![Page 21: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/21.jpg)
SCA Results: Sub-Subscale
![Page 22: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/22.jpg)
Next Step – Action Planning Review Items with scores of 0 and 1
Identify several items for action planning that may be completed within the next 3 months Look for Quick wins Define the Action Determine:
» Who is responsible» When it will be accomplished» Progress monitoring schedule for problem solving
![Page 23: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/23.jpg)
SAMPLE ACTION PLAN
![Page 24: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/24.jpg)
District Capacity Assessment (DCA)
Purpose: Measure of the capacity for implementation of
effective innovations in schools, districts, and regions in the state
Provide a structured process for the development of a District Capacity Action Plan
Administration: Completed by District Implementation Team 2x a year
![Page 25: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/25.jpg)
DCA Screenshot
![Page 26: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/26.jpg)
DCA Results
![Page 27: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/27.jpg)
Observation Tool for Instructional Supports and Systems (OTISS)
Purpose: Measure of the quality of systems and
supports available to help teachers use best practices for instruction
Implementation Team accountability
NOT teacher accountability
![Page 28: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/28.jpg)
OTISS: Development Hattie (2009) meta-meta-analysis Select instruction practices
Evidence-based (demonstrated to improve student outcomes)
Observable in a 10-minute segment of instruction Not event/time related (any 10-minute segment) Content Free Applicable to any grade level
![Page 29: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/29.jpg)
OTISS Screenshot
![Page 30: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/30.jpg)
OTISS Usability Testing Data(all schools)
![Page 31: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/31.jpg)
OTISS Usability Testing Data(by school)
![Page 32: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/32.jpg)
OTISS Usability Testing Data (by intervention)
![Page 33: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/33.jpg)
Cascading Model & Measures
Student outcomes (monthly data)
OTISS (every teacher, 3x semester)
DCA (2-3X a year)
RIT (SCA: 2X a year)
SMT/STS (SCA: 2X a year)
![Page 34: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/34.jpg)
Try It Now!
(continued)Using Data for Action Planning
Action Planning &
State Capacity Assessment
Utilizing the provided sample results of the SCA, identify at
least 2-3 next steps.
![Page 35: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/35.jpg)
Cascading Logic Model: Putting it all together
![Page 36: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/36.jpg)
The AI Hub
![Page 37: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/37.jpg)
GET CONNECTED!
http://www.scalingup.org
For more on Implementation Sciencehttp://nirn.fpg.unc.edu
http://www.globalimplementation.org
SISEP @SISEPcenter
![Page 38: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/38.jpg)
Caryn Ward, Ph.D.919-843-5787
[email protected] Porter Graham Child Development
Institute
University of North Carolina
Chapel Hill, NC
http://nirn.fpg.unc.edu/
http://www.scalingup.org
http://implementation.fpg.unc.edu
Barbara Sims919-843-8751
Frank Porter Graham Child Development Institute
University of North Carolina
Chapel Hill, NC
http://nirn.fpg.unc.edu/ http://www.scalingup.org
http://implementation.fpg.unc.edu
For More Information
![Page 39: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/39.jpg)
GIC 2015Dublin, Ireland
![Page 40: Planning for Success: Using Implementation Data to Action Plan for Full and Sustained Implementation Barbara Sims Caryn Ward National SISEP Center National](https://reader035.vdocuments.us/reader035/viewer/2022062715/56649d745503460f94a54ef3/html5/thumbnails/40.jpg)
©Copyright Dean Fixsen and Karen BlaseThis content is licensed under Creative Commons license CC BY-NC-ND, Attribution-NonCommercial-NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial — You may not use this work for commercial purposes; No Derivative Works — You may not alter or transform this work. Any of the above conditions can be waived if you get permission from the copyright holder.
http://creativecommons.org/licenses/by-nc-nd/3.0