evidence-based practice in health care management
DESCRIPTION
Evidence-Based Practice in Health Care Management Presentation for the American College of Physician Executives April 27, 2013, New YorkTRANSCRIPT
![Page 1: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/1.jpg)
Evidence-Based Management
A New Approach to Teaching the Practice of Management
ACPE Annual Meeting, April 26 30, 2013, New York
Tony Kovner, Michiel Bosman, Eric Barends
![Page 2: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/2.jpg)
EBMgt: My Experiences
EBMgt as a Process
Why Don’t Managers use it?
Learning from Medicine
Contributions of Organizational Behavior
Experience in Teaching
The Politics of EBMgt
![Page 3: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/3.jpg)
EBMgmt: Definition
“…the systematic, evidence-informed
practice of management, incorporating
scientific knowledge in the content and
process of making decisions.”
(Rousseau 2012)
![Page 4: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/4.jpg)
EBMgt as a process
Framing the question behind the decision
Finding the sources of information
Assessing the accuracy of information
Assessing the applicability of information
Assessing the actionability of information
Determining if the information is adequate
(Hsu and others 2009)
![Page 5: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/5.jpg)
Why don’t Managers use EBMgt?
Never heard of it. They are using it.
Cost now more probable than benefits in the future
Managers have to be persuaded and trained
The process doesn’t clearly lead to one-best way to intervene
Politics impacts interests
![Page 6: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/6.jpg)
Learning from EB-Medicine
Interventions that achieve positive
predictable results
Hindrances that blocked implementation of
EBM same now for EBMgt
Financial as well as political impacts
![Page 7: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/7.jpg)
Contributions of Organizational Behavior
Hiring Talent-relying on structured interviews
(Rousseau)
Challenging Performance goals impacting on
performance (Latham and Locke)
Managers who set a vision outperform other
managers (Kirkpattrick)
![Page 8: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/8.jpg)
Teaching EBMgt
NYU / Wagner, Capstone course
Projects
Hourly nurse rounding process
Redesigning the nurses’ clinical ladder
Improving the supply distribution process
Identifying causes of emergency department waiting
![Page 9: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/9.jpg)
The Politics of EBMgmt
Evidence is not sufficient to change people’s
behavior
The quality of the argument and story-telling by
persons presenting the evidence is what persuades
stakeholders
How persuade the manager that this is in his own
interest?
![Page 10: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/10.jpg)
Michiel Bosman MD MMM FACPEMD, University of Amsterdam
MMM, CMU
Exec PhD (2015), OSU Spears School
Collaborator, Center for EBMgmt
Serial Entrepreneur
![Page 11: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/11.jpg)
“there is a large research-user gap”
“practitioners do not read academic journals”
“the findings of research into what is an effective intervention
are not being translated into actual practice”
“the relevance, quality and applicability of research is
questionable”
“practice is being driven more by fads and fashions than
research”
“many practices are doing more harm than good”
What field is this?
![Page 12: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/12.jpg)
McMaster University Medical School, Canada
Medicine: Founding fathers
David Sackett Gordon Guyatt
![Page 13: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/13.jpg)
How it all started
![Page 14: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/14.jpg)
More than 1 million articles in 40,000 medical journals per
year (= 1995; now probably more than 2 million). For a
specialist to keep up this means reading 25 articles every
day (for a primary care physician more than 100!)
Problem: too much ‘evidence’
![Page 15: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/15.jpg)
Problem: too much evidence
HRM: 1,350 articles in 2010 (ABI/INFORM). For an HR
manager to keep up this means reading 3 to 4 articles
every day (for a ‘general’ manager more than 50!)
![Page 16: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/16.jpg)
Problem: too many half truths
BTW: most of the research is seriously flawed or irrelevant
for practice. And some claim so is most management advice.
![Page 17: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/17.jpg)
The 5 steps of Evidence-Based Practice
1. Formulate a focused question (Ask)
2. Search for the best available evidence (Acquire)
3. Critically appraise the evidence (Appraise)
4. Integrate the evidence with your professional
expertise and apply (Apply)
5. Monitor the outcome (Assess)
![Page 18: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/18.jpg)
1. Incompetent people benefit more from feedback than
highly competent people.
2. Task conflict improves work group performance while
relational conflict harms it.
3. Encouraging employees to participate in decision
making is more effective for improving organizational
performance than setting performance goals.
True or false?
![Page 19: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/19.jpg)
How evidence-based are managers?
959 (US) + 626 (Dutch) HR professionals
35 statements, based on an extensive body of
evidence
true / false / uncertain
On average: 35% - 57% correct
HR Professionals' beliefs about effective human resource practices: correspondence between research and practice, (Rynes et al, 2002, Sanders et al 2008)
![Page 20: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/20.jpg)
Evidence-Based Practice
1991 Medicine
1998 Education
1999 Social care, public policy
2000 Nursing
2005 Criminal justice
2010 Marketing
2013 Healthcare Management?
![Page 21: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/21.jpg)
Evidence-Based Consulting
Close the research/practice gap
Professor + Consultant
EB Mgmt Workshops
Teach the 5 step EB Practice process
Answer business questions
CAT: Critically Appraised Topic
![Page 22: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/22.jpg)
Closing the research/practice gap
Executive Doctorate in Management
University of Maryland College
Oklahoma State University
Development of tools to measure EB
Mgmt Attitudes (EBMAS) and
skills/competencies (Fresno)
![Page 23: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/23.jpg)
Teaching Evidence Based Practice to managers
![Page 24: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/24.jpg)
Evidence?
intuition, expertise, personal
experience, collective experience,
organizational facts & data,
best practices, benchmarking,
outcome of scientific research
![Page 25: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/25.jpg)
All managers base their
decisions on ‘evidence’
![Page 26: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/26.jpg)
BUT ...
![Page 27: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/27.jpg)
Managers give little
or no consideration to the
quality of the evidence
they base their decisions on
![Page 28: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/28.jpg)
SO ...
![Page 29: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/29.jpg)
Teach managers how to find
and and critically appraise
the evidence before they
make their decision
![Page 30: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/30.jpg)
The 5 steps of EBP
1. Formulate a focused question (Ask)
2. Search for the best available evidence (Acquire)
3. Critically appraise the evidence (Appraise)
4. Integrate the evidence with your professional
expertise and apply (Apply)
5. Monitor the outcome (Assess)
![Page 31: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/31.jpg)
0. Creating awareness
Why do we need it?
![Page 32: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/32.jpg)
Trust me, 20 years of management experience
![Page 33: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/33.jpg)
Errors and Biases of Human Judgment
![Page 34: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/34.jpg)
Seeing order in randomness Mental corner cutting Misinterpretation of incomplete data Halo effect False consensus effect Attribution error Group think Self serving bias Sunk cost fallacy Cognitive dissonance reduction
Confirmation bias Outcome bias Authority bias Small numbers fallacy Recall bias Anchoring bias Inaccurate covariation detection
Errors and Biases of Human Judgment
![Page 35: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/35.jpg)
1. Formulate a focused question
![Page 36: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/36.jpg)
Asking the right question?
Does team-building work?
Does the introduction of self-steering teams work?
Does lean management improve the performance of
our hospital?
Is 360 degree feedback for doctors effective?
![Page 37: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/37.jpg)
What is a ‘team’?
What kind of team?
In what contexts/ settings?
What counts as ‘team-building’?
What does ‘work’ mean?
Focused question?
Does team-building work?
![Page 38: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/38.jpg)
P = Population
I = Intervention or success factor
C = Comparison
O = Outcome
C = Context
Answerable question: PICOC
![Page 39: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/39.jpg)
P = Population
I = Intervention or successfactor
C = Comparison
O = Outcome
C = Context
Focused question: PICOC
Employee productivity?
Patient satisfaction?
Return on investment?
Market share?
Organizational commitment?
![Page 40: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/40.jpg)
2. Finding the best available evidence
![Page 41: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/41.jpg)
Best available experiential evidence
Best available internal evidence
Organizational values and stakeholders’
concerns
Best available external evidence
Evidence-based decision
Evidence-based decision
scientific
research
![Page 42: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/42.jpg)
Scientific databases: management
ABI/INFORM
Business Source Elite
PubMed
PsycINFO
Web of Knowledge
ERIC
![Page 43: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/43.jpg)
3. Critical appraisal of studies
Making sense of evidence
![Page 44: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/44.jpg)
Critical appraisal
Construct validity (lean six sigma = value stream mapping, root cause analysis, goal setting, participative decision making)
Internal validity (does it work?)
External validity (will it also work for my employees / organization?)
![Page 45: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/45.jpg)
Levels of internal validity
![Page 46: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/46.jpg)
Best research design?
Best available
![Page 47: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/47.jpg)
Critical appraisal
![Page 48: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/48.jpg)
Step 4: Turning evidence into practice
![Page 49: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/49.jpg)
Applicable?
organizational characteristics
cultural & political aspects
financial aspects /cost-effectiveness / ROI
priorities
change readiness / resistance to change
implementation capacity
timing
![Page 50: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/50.jpg)
TEST?
![Page 51: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/51.jpg)
CAT: Critically Appraised Topic
![Page 52: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/52.jpg)
CAT-walk
![Page 53: Evidence-Based Practice in Health Care Management](https://reader034.vdocuments.us/reader034/viewer/2022042813/5471c2dab4af9fc30a8b4c3e/html5/thumbnails/53.jpg)
Evidence-based practice:
If doctors can do it managers can do it!