coaching pdsa cycles - carnegie foundation for the...
TRANSCRIPT
![Page 1: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/1.jpg)
Coaching PDSA Cycles
Alicia Grunow Co-Founder Improvement Collective Senior Fellow, Carnegie Foundation
Melissa Chabran Associate, Carnegie Foundation
Christina Dixon Associate, Carnegie Foundation
Emma Parkerson Associate, Carnegie Foundation
![Page 2: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/2.jpg)
Objectives
Understand how PDSAs fit into the larger improvement science context
Be able to assess the learning from a PDSA
Be able to determine next steps in building a team’s capacity to run PDSAs
2
![Page 3: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/3.jpg)
PDSA Expertise Development
3
(1) KNOW ABOUT PDSAs
(2) EXPERIENCE USING PDSAs
(3) COACH OTHERS PDSAS
(4) TEACH/ DESIGN TESTING
STRATEGY
(1) Create a TRIAD with at least 1 person that currently coaches (2) Introduce yourself (BRIEFLY) to your group
• One thing you hope you learn today
![Page 4: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/4.jpg)
Agenda
Introduction to PDSAs in an improvement context
Practice PDSA coaching – Assessing PDSAs – Deciding where to focus – Setting up a coaching conversation
Tips and Tricks
4
![Page 5: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/5.jpg)
Organize asnetworks
Learn throughdisciplined
inquiry
Embracemeasurement
Attend tovariability
Seethe system
Be problem-focused
and user-centered
CORE PRINCIPLES OFIMPROVEMENT
6
![Page 6: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/6.jpg)
6
Lesson Study
ROCI Datawise
Action Research
Forms of Disciplined Inquiry in Education
PLC Cycle
PDSA Cycle
![Page 7: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/7.jpg)
8
PLAN
DO STUDY
ACT
What specifically are we trying to accomplish?
What change might we make and why?
How will we know that a change is an improvement?
The Model for Improvement Associates for Process Improvement
![Page 8: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/8.jpg)
Theory Informs Testing and in Turn Testing Refines Theory
Bennett and Provost 2015
PLAN
DO STUDY
ACT
Aim
![Page 9: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/9.jpg)
Learning Your Way into Improvement
API 2013
Changes that result in an
improvement A P S D
A P S D
Develop a change
Test under varied conditions
Wide-Scale Tests of Change
Implement the Change
Hunches Theories
Ideas
![Page 10: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/10.jpg)
Inquiry in Improvement Science
Prediction based test of change
The improvement aim disciplines the focus of inquiry
Paired with process and outcome data (as well as other improvement tools)
Flexible methodology that can be applied to varied practices and used at different sizes
Results in common evidence based practices (and theory of improvement)
11
![Page 11: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/11.jpg)
Organize asnetworks
Learn throughdisciplined
inquiry
Embracet
Attend tovariability
Seethe system
Be problem-focused
and user-centered
CORE PRINCIPLES OFIMPROVEMENT
6
Problem
System Map
Step Step Step Step Step P D
S A
![Page 12: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/12.jpg)
13
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What can you build on? What would push work
forward?
What stance is most appropriate?
Coaching Improvement
![Page 13: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/13.jpg)
14
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What would push work forward?
What stance is most appropriate?
Coaching Improvement
![Page 14: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/14.jpg)
Articulating and Testing Hypotheses
@2009 API
PLAN • What’s your change? • What’s your prediction?
• Plan to conduct test
DO • Execute test • Collect data, document observations
STUDY • Compare results
to prediction • What did you
learn?
ACT • Next steps: Adapt, adopt, abandon
Making your theories,
assumptions and hypotheses
explicit
Revealing gaps in our
understanding
![Page 15: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/15.jpg)
16
WHERE to look
![Page 16: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/16.jpg)
PLAN
DO
STUDY
ACT
The PDSA Cycle ARTICULATION OF A CLEAR HYPOTHESIS -change -goal -predictions
WHERE to look
![Page 17: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/17.jpg)
18
Subject Matter Knowledge
Improvement Knowledge
Success!
Subject Matter Knowledge: Research and professional knowledge about the content of what you are improving
Improvement Knowledge: The interaction of the theories of systems, variation, knowledge, and psychology.
?
Subject Matter vs. Improvement
![Page 18: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/18.jpg)
PLAN
DO
STUDY
ACT
The PDSA Cycle ARTICULATION OF A CLEAR HYPOTHESIS -change -goal -predictions
DESIGN OF THE EXPERIMENT -Scale of test -Data collection
DOCUMENTATION OF LEARNING -Carry out -Record surprises -Compare predictions to what happened
REVISE INITIAL HYPOTHESIS -New learning and theory refinement -Next steps
WHERE to look
![Page 19: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/19.jpg)
20
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What would push work forward?
What stance is most appropriate?
Coaching Improvement
① Use the PDSA look-fors to assess two PDSAs ② Compare with your triad
![Page 20: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/20.jpg)
21
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What can you build on? What would push work
forward?
What stance is most appropriate?
Coaching Improvement
![Page 21: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/21.jpg)
22
Level of Engagement
DEFIANT ACTIVE / ENTHUSIASTIC
PASSIVE / COMPLIANT
ENGAGED / CURIOUS
![Page 22: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/22.jpg)
23
Developmental Trajectory
NOVICE EXPERT COMPETENT
![Page 23: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/23.jpg)
24
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What stance is most appropriate?
Coaching Improvement
① Choose ONE PDSA to work with as a triad ② Individually determine:
• One asset you would build on • One specific area in which you would focus
③ Share your rationale with your triad
What can you build on? What would push work
forward?
![Page 24: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/24.jpg)
25
Expertise Development
NOVICE EXPERT COMPETENT
Personally meaningful learning!
Predictions
Change ideas
Tests that build
Efficiency of testing Analysis
Quality change ideas
Rhythm (execution)
![Page 25: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/25.jpg)
26
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What would push work forward?
What stance is most appropriate?
Coaching Improvement
![Page 26: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/26.jpg)
27
Stances
Inquire (Asking)
Directive (Telling)
Facilitative (Guiding)
Accessing your own ignorance
Sharing your knowledge
Pulling out what they know; co-construct
“Making your predictions more
specific is going to help drive your learning.”
“Tell me about what you have
been learning...”
“Where’s your next opportunity
to test this?”
“It sounds like your hypothesis
is….“
![Page 27: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/27.jpg)
28
Coaching WHERE to look INTERPRET/ASSESS
what you see Decide what to
FOCUS on Decide coaching
STANCE
What’s important? What’s going well? What’s not?
What would push work forward?
What stance is most appropriate?
Coaching Improvement
You have a 30 minute conversation coming up with the team. You want to get to the next PDSA. ① How would you structure the
conversation? ② What stance(s) would you use in each
part? (Identify and possibly roll play specific questions.)
![Page 28: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/28.jpg)
PLAN
DO
STUDY
ACT
The PDSA Cycle • Limited or vague predictions • Unspecific change idea
• Difficulty identifying opportunities to learn
• No data collection sheet
• Difficulty in abstracting from what happened in the test
Top 10 Common Breakdowns
• Report doing PDSAs but no documentation
Mad Libs
• Not strategic in testing • Learning that doesn’t “travel” • No routine for learning • Social settings that don’t support sense-making
Draw your theory
Facipulate PDSAs
3 pieces of paper
Coach as documenter
Coaching
Cross school PDSAs
![Page 29: Coaching PDSA Cycles - Carnegie Foundation for the ...summit.carnegiefoundation.org/session_materials/E1...Theory nfI orms Testing and in Turn Testing Refnei s Theory . Bennett and](https://reader034.vdocuments.us/reader034/viewer/2022050414/5f8b104ddac2cf402244c39c/html5/thumbnails/29.jpg)