evidence-based policy on physical activity: the tale of the emperor's new clothes ·...

29
Evidence-based policy on physical activity: the tale of the Emperor's New Clothes Nick Cavill PhD

Upload: others

Post on 15-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Evidence-based policy

on physical activity:

the tale of the

Emperor's New

Clothes

Nick Cavill PhD

Page 2: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 3: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 4: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

“Use of robust evidence to inform

public health policy is likely to

ensure the greatest and most

equitable population health gains”

Macintyre S. Evidence based policy making. BMJ 2003;326:5-6.

Page 5: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

“Our new approach across public health

services must meet tougher tests of evidence

and evaluation . . . We must only support

effective interventions that deliver proven

benefits.”

Andrew Lansley, Secretary of State for Health.

Speech to the Faculty of Public Health conference in

July 2010

Page 6: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

'the integration of experience,

judgement and expertise with the

best available external evidence from

systematic research'

Davies, 1999, Civil Service Policy Hub

Evidence-based policy

Page 7: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Evidence trajectories

Time

Hunch-based

Leve

l o

f a

ctiv

ity

Evidence-based

Page 8: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Absence of evidence?

or

Evidence of absence?

Page 9: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 10: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Smith GCS, Pell JP. (2003). Parachute use to prevent

death and major trauma related to gravitational

challenge: systematic review of randomised

controlled trials. BMJ, 327(7429),

no RCT evidence was found to

support the use of parachutes in

preventing death when exiting a

plane at high altitudes

We think that everyone might

benefit if the most radical

protagonists of evidence-based

medicine organised and

participated in a double-blind,

randomised, placebo-controlled,

crossover trial of the parachute.

Page 11: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 12: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 13: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

4

18

16

9

4

0

2

4

6

8

10

12

14

16

18

20

strong

evidence

effective

weak

evidence

effective

absence of

evidence

mixed

evidence

weak

evidence

ineffective

Evidence for statements in public health white paper

No. studies

Srinivasa Vittal Katikireddi, Martin Higgins, Lyndal Bond, Chris Bonell, Sally Macintyre.

How evidence based is English public health policy? BMJ 2011;343:d7310 doi:

10.1136/bmj.d7310 (Published 17 November 2011)

Page 14: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Srinivasa Vittal Katikireddi, Martin Higgins, Lyndal Bond, Chris Bonell, Sally Macintyre.

How evidence based is English public health policy? BMJ 2011;343:d7310 doi:

10.1136/bmj.d7310 (Published 17 November 2011)

Page 15: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 16: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 17: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Olympic Legacy

• McCartney G, Thomas S, Thomson H, Scott J, Hamilton V, Hanlon P, et al. The health and socioeconomic impacts of major multi-sport events: systematic review (1978-2008). BMJ 2010;340:c2369.

• Weed M, Coren E, Fiore J. A systematic review of the evidence base for developing a physical activity and health legacy from the London 2012 Olympic and Paralympic Games. London: Centre for Sport, Physical Education & Activity Research (SPEAR), Canterbury Christ Church University, 2009

• Murphy NM, Bauman A. Mass sporting and physical activity events--are they "bread and circuses" or public health interventions to increase population levels of physical activity? J Phys Act Health. 2007 Apr;4(2):193-202.

Page 18: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

"The participation target was intrinsically flawed from the

outset, not just because it was more convincing as a sales

pitch than a policy objective, but also because engaging any

number of additional people in some unspecified sporting

activity is not the same thing as a serious, targeted work

aimed at transforming the lives of Britain's neediest people."

Page 19: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 20: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Exercise on referral

Page 21: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Exercise on referral

• Sport-led

• Refer to facility

• Poor evidence base

• Health-led

• Often counselling

• Strong evidence

Page 22: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Williams NH, Hendry M, France B, Lewis R, Wilkinson C. Effectiveness of

exercise-referral schemes to promote physical activity in adults:

systematic review. British Journal of General Practice 2007;57:979-86.

Pavey TG, Anokye N, Taylor AH, Trueman P, Moxham T, Fox KR, et al. The

Effectiveness and Cost-effectiveness of Exercise Referral Schemes: A

Systematic Review and Economic Evaluation. Exeter: Peninsula College of

Medicine and Dentistry, 2011.

Anokye NK, Trueman P, Green C, Pavey TG, Hillsdon M, Taylor RS. The

cost-effectiveness of exercise referral schemes. BMC Public Health. 2011

Sowden SL, Raine R. Running along parallel lines: how political reality

impedes the evaluation of public health interventions. A case study of

exercise referral schemes in England. J Epidemiol Community Health.

2008 Sep;62(9):835-41.

Exercise Referral

Page 23: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Led walks programmes

Page 24: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 25: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 26: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

Use evidence

Create evidence

Page 27: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence
Page 28: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence

“wanton large-scale experimentation is

unethical, and needs to be superseded by a more

rigorous culture of piloting, evaluating and using

the results to inform policy.”

House of Commons Health Select Committee

Page 29: Evidence-based policy on physical activity: the tale of the Emperor's New Clothes · 2012-03-09 · the tale of the Emperor's New Clothes Nick Cavill PhD “Use of robust evidence