Building Stronger Professional Development Systems: Using Data to Improve Implementation
Jennifer Coffey, Ph.D.OSEP Project Director and SPDG Program Lead
Audrey DesjarlaisKnowledge Mobilization Coordinator, Signetwork
Implementation: Research on Tools; Research as Tool Sonja K. Schoenwald Professor of Psychiatry & Behavioral Sciences Medical University of South Carolina August 20, 2013, Global Implementation Conference.
TODAY’S AGENDA
AGENDA – Day One Continued
Thank You! Planning Committee Members, Staff, and Facilitators
OSEP • Jennifer Coffey• Tina Diamond• David Guardino• Pat Gonzalez• Shedeh Hajghassemali• Terry Jackson• Greg Knollman• Ingrid Oxaal• Corinne Weidenthal• Susan Weigert• Grace Zamora Duran
Signetwork Staff• Linda Lynch• Melissa Moseley• Leslie Stephenson• Audrey Desjarlais
SPDG Members• Susan Bailey-Anderson, Montana• Don Briere, Connecticut• Kathy Cox, Illinois• Alice Henley, Connecticut• David Merves, Delaware & New
Hampshire• Brenda Oas, North Dakota• Mary Steady, New Hampshire
RRCP Implementation Core Team • Jeanna Mullins, Mid-South RRC• Kim Hartsell, Southeast RRC• Nancy O’Hara, Mid-South RRC
Invited Guests
OSERS• Michael Yudin, Acting Assistant Secretary, US Department of
Education
OSEP• Melody Musgrove, Director, OSEP• Ruth Ryder, Deputy Director, OSEP• Larry Wexler, Director, Research to Practice Division
Parent Centers/ Regional PTACs• Barbara Buswell, Region 5 • Debra Jennings, Region 1 • Connie Hawkins, Region 2 • Nora Thompson, Region 6
SPDG Participation• 43 States Represented• State teams range from
• 1 rep (8 states) CA, CO, MA, MN, NE, PA, VA, WI • 2 reps (4 states) AR, MT, RI, SC • 3 reps (6 states) AL, ID, NC, OR, VT, WY• 4 reps (9 states) AK, CT, IL, IN, KS, KY, MO, NM, TN• 5 reps (8 states) DE, FL, GA, MD, MI, NH, OH, OK, UT• 6 reps (1 state) MS
• Partners include representatives from: Parent Organizations, Institutes of Higher Education
Welcome!
Fiscal Year (FY) 2014• FY 2015
• What you can do to prepare• GPRA/Program Measures• Partners• Current/past data – telling your story• Start sharing with others what a new
SPDG could accomplish• IDEA Statute – SPDG• www.Signetwork.org
The Letter and Spirit of the Law
• Partnerships• Serving children with disabilities• Fulfilling the purpose of your project
GPRA/Program Measures – Pilot Review•External Review Results for FY 2012• Program Measure 1: 11 of 22 initiatives (50%)
met the set targets• Program Measure 2: 4 of 22 (18%) initiatives
met the targets they set • Program Measure 3: 7 out of 22 (32%)
initiatives me the targets they set • Program Measure 4: 1 out of 1
Reliability for the pilot• For Program Measure 1 more variation in scores
– from complete agreement to 44% difference.• For Program Measure 2 there were no
disagreements for the first pair of reviewers and just 1 disagreement for the 2nd pair.
• For Program Measure 3, there was 1 disagreement for the first pair of reviewers and 4 disagreements for the 2nd pair.
• For Program Measure 4, there was 1 disagreement for the first pair and none for the second pair.
Current External Review
• Westat – Data Quality Initiative• Will produce a 1-page document that
summarizes each project’s results• OSEP will provide another FAQ document to
improve the data coming from projects
This Meeting
• Why focus on implementation fidelity?
• Implementation Science• We are the resource• Other resources – AI Hub
INTRODUCTIONS – ALLISON METZ
SMALL GROUP DISCUSSIONS
Discussion Process
PURPOSE: • To learn from others about tools and
approaches in using data to:•define your practice,•improve the fidelity of the practice•effectively engage the various drivers to support the use of data
Discussion Process
1. Pick a topic• ?s to define the what and how – of the
‘what’• ?s to improve the fidelity of ‘what’ through
the implementation drivers • ?s about coaching systems to improve the
fidelity of ‘what’
Discussion Process
2. State Teams – Split up3. Groups – 8-10 people4. Facilitator – OSEP & RRCP5. Listen & Engage6. Write your questions7. Take Notes8. Return to Academy Hall for Allison &
Jennifer’s Q&A session – 11:30 AM
LARGE GROUP Q & A
What’s Next
11:45-1:00pm - Lunch on your own, dining options in packet
1:00-1:30pm – State team time, Action Planning, Meet with your evaluators or Meet with Project Officers
AFTERNOON SESSIONS
DAY TWO – BEGINS @ 8:00am-Project Sharing-U.S. Dept of Ed Presentation