translating “translation:” what do we know? what can we do ...€¦ · dearing’s top 10...

36
Translating “Translation:” What do we know? What can we do better? Rita K. Noonan, PhD Division of Unintentional Injury Prevention National Center for Injury Prevention & Control CDC

Upload: others

Post on 09-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Translating “Translation:” What do we know? What can we do better?

Rita K. Noonan, PhD

Division of Unintentional Injury Prevention

National Center for Injury Prevention & Control

CDC

Page 2: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

“Discovery to delivery”

• 10-17 year delay. A generation

• AHRQ data:

–$95 Billion in development, but only 1% to study implementation

• Serum without the syringe?

Page 3: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

The Problem

• We have strategies that “work”

• Little research to understand adoption & effective use

• Poor use of resources & scientific discoveries

• Result: more death, disability, and injury

Page 4: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

CENTRAL IDEA

We can do better

Page 5: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

The Research-Practice Process

Define theProblem

Develop & TestPrevention Strategies

Assure Widespread

Adoption

Identify Risk &Protective Factors

RESEARCH PRACTICE

Page 6: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

The Dissemination/ Implementation Process

Develop & TestPrevention Strategies

Dissemination/

Implementation

Process

Assure WidespreadAdoption

RESEARCH PRACTICE

Page 7: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Why the black box?

•Training

•Reward Structures

•R&D Bias in Funding

Page 8: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate
Page 9: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

If You Build It…(excerpts from Emshoff 2008)

• They may not find it

• They may not feel invited

• They may find it irrelevant

• They may think they already have it

• They may rebuild it

• They may love it & want 10 more. NOW

Page 10: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

What’s In a Name?

• Knowledge to Action

• Research to Practice

• Knowledge Translation

• Knowledge Transfer

• Technology Transfer

• Diffusion• Diffusion of

Innovation• Implementation• Dissemination and

Implementation• Translation• Science to Service

Page 11: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Whatever we call it…

What is it?

Page 12: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

It’s a Simple Question -

What are the best modalities for disseminating what kinds of information to what kinds of individuals within what types of organizations about what kinds of programs - leading to what decisions about adoption - leading to what dimensions and levels of fidelity and adaptation, as moderated by what kinds of capacity building, technical assistance, training, monitoring, and supervision?

Page 13: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Distilling the Information— Prevention Research System

Supporting the Work—Prevention Support System

Putting It Into Practice—Prevention Delivery System

Synthesis

General Capacity Building

Innovation-Specific Capacity Building

General Capacity Use

Innovation-Specific Capacity Use

Policy Climate

Funding

Existing Research and Theory

Translation

Interactive Systems Framework

Page 14: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Distilling the Information— Prevention Research System

Supporting the Work—Prevention Support System

Putting It Into Practice—Prevention Delivery System

Synthesis

General Capacity Building

Innovation-Specific Capacity Building

General Capacity Use

Innovation-Specific Capacity Use

Policy Climate

Funding

Existing Research and Theory

Translation

Interactive Systems Framework

Page 15: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

What would Coke do?

Page 16: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Distillation System

• Knowledge of end users’ preferences, learning style, networks

• User-friendly, accessible materials

• Core components

• Include end users in creation and dissemination

Page 17: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Dearing’s Top 10 Dissemination Mistakes

1. We assume evidence matters in the decision making of potential adopters

2. We substitute our perceptions of those of potential adopters

3. We use intervention creators as intervention communicators

4. We introduce interventions too early

5. We assume that information will influence decision-making

Page 18: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

6. We confuse authority with influence

7. We allow the first to adopt (innovators) to self-select into our dissemination efforts

8. We fail to distinguish among change agents, authority figures, opinion leaders and innovation champions

9. We select demonstration sites on criteria of motivation and capacity

10.We advocate single interventions as the solution to a problem

Page 19: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Distilling the Information— Prevention Research System

Supporting the Work—Prevention Support System

Putting It Into Practice—Prevention Delivery System

Synthesis

General Capacity Building

Innovation-Specific Capacity Building

General Capacity Use

Innovation-Specific Capacity Use

Policy Climate

Funding

Existing Research and Theory

Translation

Interactive Systems Framework

Page 20: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Coke’s Infrastructure

Page 21: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Scalability and Scaling Up

We often ask:

“Is it scalable?”

“Is it feasible?” (Arby’s Test Kitchen)

We need to ask:

“Is it SCALE WORTHY?”

Page 22: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Equity Framework

22

Page 23: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Support (capacity-building) System

* Knowledge is not sufficient to change behavior. Think: smoking, fast food.

* Capacity: motivation, skill sets, training, infrastructure, staff.

• Fixsen’s Core Implementation Components (compensatory)

• Kerner & Hall

Page 24: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Importance of Capacity

• Systematic Training

• Coaching and Monitoring

• Leadership – key to findings

•All these influence implementation

Page 25: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Joyce & Showers Meta-Analysis (2002)

Component Knowledge Skill Demonstration

Use in Class

Theory & Discussion

10% 5% 0%

Training Demo

30% 20% 0%

Practice & Feedback

60% 60% 5%

Coaching in Classroom

95% 95% 95%

Page 26: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

To Achieve Health Impact:

We need 2 things

1. Effective Interventions

2. Effective Implementation

Page 27: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Effectiveness – 2 axes

HI EffectivenessHI Implementation*Model program

implemented with fidelity

HI EffectivenessLO Implementation*Half of model program

sessions are delivered

LO EffectivenessHI Implementation*DARE implemented

with fidelity to content and delivery format

LO EffectivenessLO Implementation*One-hour session in

assembly hall delivered by a boring person

Page 28: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Distilling the Information— Prevention Research System

Supporting the Work—Prevention Support System

Putting It Into Practice—Prevention Delivery System

Synthesis

General Capacity Building

Innovation-Specific Capacity Building

General Capacity Use

Innovation-Specific Capacity Use

Policy Climate

Funding

Existing Research and Theory

Translation

Interactive Systems Framework

Page 29: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Delivery (or practice) System• Adoption influenced by individual users’

perceptions (e.g., Hard to use? Do I benefit?)

• Ex: DARE Program. Widely adopted, but not effective. Why so popular?

• Organizational factors: fit with mission? Culture? Administrative support? Bureaucratic obstacles?

Page 30: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

What now?

Page 31: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Nudges & Persuasion

Choice Architecture:• Healthy Defaults• Anchors• Follow the Herd• Loss Aversion• Framing

Page 32: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

What does this mean for public health?

• We all have a role in closing gap

• “perfect science” not always useful in real world

• We want both “evidence-based practice” AND “practice-based evidence”

Page 33: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

What can we do?• Start with existing efforts & evaluate

• Understand what practitioners need

• Design and evaluate strategies that are feasible to use in organizations characterized by:

Limited resources

High turnover rates

Varied skill levels

Page 34: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

What can we do?

• Build capacity before dissemination

• Follow DOI and social marketing

• Emphasize benefits to adopters

• Bundle interventions

Page 35: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Read more…

Special Issue, June 2008

Collection illuminates

CDC framework

Page 36: Translating “Translation:” What do we know? What can we do ...€¦ · Dearing’s Top 10 Dissemination Mistakes. 1. We assume evidence matters in the decision ... 10.We advocate

Thank you!

Rita K. Noonan, PhD.

[email protected]

770-488-1532*Ask me to send you articles