are people naively optimistic? · professor tammy hoffmann centre for research in evidence-based...

32
Are people naively optimistic? A systematic review of expectations of the benefits and harms of treatments, screening, and tests Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann

Upload: others

Post on 26-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Are people naively optimistic?

A systematic review of expectations ofthe benefits and harms of treatments,

screening, and tests

Professor Tammy Hoffmann

Centre for Research in Evidence-Based Practice

Bond University

@Tammy_Hoffmann

Page 2: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 3: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 4: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 5: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 6: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Lessons from this story?

• Our expectations can influence our decisionsand behaviours

• Making assumptions without checking thefacts first can be dangerous!

• The chicken assumed the worst…

Page 7: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

JAMA Int Med 2015175:274–86

Page 8: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Background

• Increasing costs of health interventions andoveruse of many

• Multiple possible causes▫ Patient assumptions about intervention benefit and

“more is better” likely plays a role

Existing studies of individuals’ expectations of benefitand harm fragmented across the literature

Page 9: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Inclusion criteria• All studies

….in which participants were asked to provide aquantitative estimate of the expected benefitsand/or harms of a treatment, test, or screen

• Outcomes were eligible if they asked about thechance of the benefit or harm occurring and/or thesize of it.

Not eligible:

• Descriptive estimates (e.g. “much better”)

• Expectations about the risk of developing a disease

Page 10: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Methods

• Databases (MEDLINE, Embase, CINAHL, PsycINFO)up to June 2013▫ with no language or study type restriction

• Cited reference searches of included studies

• Contacted experts and study authors

• 2 researchers evaluated methodological quality andextracted data▫ where provided, a ‘correct’ contemporaneous answer

about an intervention’s benefits or harms

Page 11: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Provided ‘correct’answer

+% correct

% overestimated&/or

% underestimated

Provided‘correct’ answer

+only % correct

Did not provide‘correct’ answernumerically;narrativelyexpressed

Outcomes

ANS: 15 of 100 people

65% overestimated20% correct15% underestimated

ANS: 15 of 100 people

20% correct

“nearly alloverestimated thebenefit of…”

Page 12: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Flowchart of searching

36 articles (from 35 studies)Total of 27 323 patients

Page 13: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

About the 35 studies

Earliest: 1994

Most recent: 2013

• 69% - used multiple choice Qs

• 31% - asked to provide a quantitative estimate

e.g “out of 1000 people, how many…”

16 countries

50% from USA

• 40% - screening

• 43% - treatment

• 9% - test

• 9% - treatment and screening

Page 14: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

About the 35 studies

• Of the screening & test studies, 75% wereabout cancer:▫ Breast, prostate

▫ Bowel, cervical

• Of the 16 studies of treatments:- 18 different treatments

- Medication e.g. statins, IBD, osteoporosis, HRT

- Surgery e.g. hip/knee replacement, back surgery

- Cancer treatment e.g. mastectomy

- Other e.g. CPR, trial of labour after C-section

Page 15: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

More focus on assessment of benefit thanharm expectations

Page 16: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Expectations of benefit

54 outcomes, across 32 studies

Of the 34 outcomes with overestimation dataavailable:▫ the majority of participants overestimated

benefit for 22 (65%) of them

Majority provided correct answers for 2outcomes (cataract surgery; cervical smear test)

Majority underestimated benefit for 1outcome (surgery for low back pain)

benefits.

Overestimate

Correct

Underestimate

Page 17: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 18: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Expectations of benefit

17 outcomes with no ‘correct’ numericalanswer provided:▫ in 15 (88%), study authors concluded

that participants overestimated benefits

Overestimate

Page 19: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Expectations of harm27 outcomes, across 13 studies

Of the 15 outcomes with underestimationdata available:▫ the majority of participants underestimated

harm for 10 (67%) of them

Majority provided correct answers for 2outcomes (need glasses after cataract surgery;

miscarriage risk from amniocentesis)

Majority underestimated harm for 1outcome (breast cancer risk from HRT)

benefits.

Underestimate

Correct

Overestimate

Page 20: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 21: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Conclusions

The majority of participants

- overestimated intervention benefit

- underestimated harm harm.

Page 22: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

• Requests

• Heavy impact of patient expectations onclinicians

Page 23: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Patientexpectations

Clinicians’decisions

Assumptionsabout

interventionbenefit

Page 24: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Missed opportunities?

Expectations:

- Not detected

- Actively avoided

Page 25: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Clinicians’ contributions…

▫ Best of intentions & desire to ‘do something’

▫ Unaware of true effectiveness & benefit-harmtrade-off

▫ Lack of incentive for discouraging an intervention

▫ Pecuniary interests

Page 26: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Patientexpectations

Clinicians’decisions

Assumptionsabout

interventionbenefit

Shared decision making!

Page 27: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

• Elicit expectations

• Accurate and balanced information about benefitsand harms

• The opportunity to develop realistic expectationsand make informed decisions

Part of the solution…Shared Decision Making

Page 28: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations

Thank you

@[email protected]

Page 29: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 30: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 31: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations
Page 32: Are people naively optimistic? · Professor Tammy Hoffmann Centre for Research in Evidence-Based Practice Bond University @Tammy_Hoffmann. Lessons from this story? • Our expectations