perez.can experts.be.trusted
DESCRIPTION
Perez, Oren, Can Experts Be Trusted and What Can Be Done About it? Insights from the Biases and Heuristics Literature (September 15, 2014).Presentation at he Centre for Analysis of Risk and Regulation (CARR), LSE, 14 October 2014, Forthcoming in 'Nudging and the Law: A European Perspective'; Alberto Alemanno and Anne-Lise Sibony Eds. (HART, 2015).. Available at SSRN: http://ssrn.com/abstract=2490407TRANSCRIPT
![Page 1: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/1.jpg)
Can Experts be Trusted and what can be done about it?
Insights from the Biases and Heuristics Literature
Oren Perez, Bar Ilan University Faculty of
Law
[email protected] LSE-CARR, 14 October 2014
![Page 2: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/2.jpg)
Motivation
O Experts play a critical role in the modern
regulatory system;
O Expert groups (Commission is advised by
about 1000 expert groups, which assemble
more than 30,000 experts);
O Regulatory Agencies - e.g., the European
Food Safety Authority (EFSA), the European
Securities and Markets Authority (ESMA) or
the European Integrated Pollution Prevention
and Control (IPPC) Bureau (EIPPCB)
2
![Page 3: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/3.jpg)
Normative Background
O The objectivity ideal :
O "Experts should provide opinions which are
independent, regardless of the pressures of
litigation. In this context, a useful test of
‘independence’ is that the expert would express the
same opinion if given the same instructions by an
opposing party. Experts should not take it upon
themselves to promote the point of view of the
party instructing them or engage in the role of
advocates".
O UK Civil Justice Council. "Protocol for the Instruction of
Experts to give Evidence in Civil Claims." 2009
3
![Page 4: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/4.jpg)
Can experts be Trusted (1)?
O Should I trust this guy?
4
![Page 5: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/5.jpg)
So should experts be Trusted (2)?
O Misaligned incentives due to external
economic pressures (Conflict of Interests,
COI);
O cognitive failures.
O The key distinction between the two
categories of judgment failure is that the
latter can occur even in the absence of
COI
5
![Page 6: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/6.jpg)
Current regulatory framework :
O Focus on conflict of interest:
O Register of Expert Groups
O the European Ombudsman investigation into
the Commission’s expert groups.
O Judicial review of expert advise (via
administrative law or tort law) is weak - strong
deference to expert opinion.
O informal rules of the scientific community -
vague + the normal checking mechanisms of
science are not applicable to the regulatory
context (e.g., peer review)
6
![Page 7: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/7.jpg)
Changing the focus: Cognitive biases as a matter of regulatory concern
O Experts are not immune: their susceptibility
to bias originates in a fundamental human
tendency to couple Type 1 intuitive
processing and Type 2 analytical processing
in reasoning processes.
7
![Page 8: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/8.jpg)
Key Cognitive Biases
O Motivated Reasoning:
O confirmation bias - "the seeking or
interpreting of evidence in ways that are
partial to existing beliefs, expectations, or
a hypothesis in hand"
O disconfirmation bias - people are unable
to ignore their prior beliefs when
processing counter-arguments or counter-
evidence
8
![Page 9: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/9.jpg)
Examples of confirmation bias
O studies of diagnostic decision-making have
demonstrated that doctors are subject to
confirmation bias when they interpret evidence
(e.g., symptoms or lack of symptoms),
O "prosecutorial bias" - documented in the work of
forensic experts that work in laboratories located
in law enforcement agencies or prosecutors'
offices - and reflected in a selective treatment of
the evidence in ways that support the agenda of
the institution in which the laboratory is situated.
9
![Page 10: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/10.jpg)
Hindsight and outcome biases
O Hindsight bias - finding out that an outcome
has occurred increases its perceived
likelihood.
O Outcome bias - the influence of outcome
knowledge upon evaluations of decision
quality and the potential responsibility or
culpability of the decision-maker to the
outcome.
10
![Page 11: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/11.jpg)
The De-biasing Project (and nudging)
O De-biasing constitutes a more extensive
interventionist strategy than nudging.
O A nudge is "any aspect in the framing of a
decision problem that can affect people
decisions without changing economic
incentives" (changing, e.g., the way
information is presented or by changing
default rules).
11
![Page 12: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/12.jpg)
De-biasing may go beyond Nudging
O E.g., by changing the agent's set of choices,
increasing the transaction costs associated
with a certain decision, or by requiring the
development of new institutional structures.
O In the context of expert-decision making the
literature on de-biasing has focused on ways
to shift cognitive processing from a System
1 mode of thinking (automatic, heuristic) to
a System 2 (controlled, rule-governed) mode
of thinking. 12
![Page 13: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/13.jpg)
Debiasing techniques
(a) Introspective techniques, encouraging the
agent to self-reflect on his reasoning process,
revising it as needed (general bias awareness);
(b) Cognitive-forcing techniques - influencing the
decision-maker indirectly by changing some
features of the task or the decision-making
environment;
(c) Introducing deliberative elements into the
decision-making process - 'forcing' the expert to
consider and cope with other viewpoints.
13
![Page 14: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/14.jpg)
Checklists (1)
14
![Page 15: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/15.jpg)
Checklists (2)
15
![Page 16: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/16.jpg)
Process-conditioning rules - Design of Automatic Teller Machines
16
![Page 17: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/17.jpg)
Introspective, meta-cognitive techniques
17
![Page 18: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/18.jpg)
The fallibility of introspective de-biasing
O State 1:{A, B, C, D};
O State 2: {Eva1{A, B, C, D}-> A, B, C, ~D};
O State 3: {Eva2{Eva1{A, B, C, D}-> A, B, C, ~D}-
>A, B, ~C, D};
O …
O (n) State n: {Evan-1{Eva n-2{ Eva n-3 …
18
![Page 19: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/19.jpg)
Cognitive forcing techniques - some problems
O CFTs can generate new cognitive problems,
which potentially can undermine any
benefits achieved through the introduction
of the CFT.
19
![Page 20: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/20.jpg)
The Design of ATMs
20
![Page 21: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/21.jpg)
The pitfalls of checklists
21
![Page 22: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/22.jpg)
E-deliberation and open-gov
O The Problem of Mass E-mails/mass petitions.
O https://petitions.whitehouse.gov/
22
![Page 23: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/23.jpg)
From Theory to Policy
O The move from theory to policy is far from
trivial - requires differential approach ,
experimentation and realistic calibration of
our goals and expectations.
23
![Page 24: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/24.jpg)
Some Examples
O Methodological guidelines - examples:
O GRADE system - Grading of Recommendations
Assessment, Development, and Evaluation;
O American Medical Association’s ("AMA") Guides to
the Evaluation of Permanent Impairment (Sixth
Edition, 2007)
O Forensic Science (Report of the House of Commons
Science and Technology Committee on Forensic Science
(Second Report of Session 2013–14)
O Challenges?
24
![Page 25: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/25.jpg)
Encouraging perspective taking
O By creating a pluralistic decision-making
environment:
O revising the expert selection process
O IPCC Procedures for the Preparation, Review,
Acceptance, Adoption, Approval and
Publication of IPCC Reports,
O Blind selection and randomization
O Public deliberation (Regulation room;
regulation.gov)
25
![Page 26: Perez.can experts.be.trusted](https://reader036.vdocuments.us/reader036/viewer/2022081404/55867d3cd8b42a977a8b46bd/html5/thumbnails/26.jpg)
The ultimate objective of the de-biasing project?
From cognitive sterility - to the creation of
reflexive and epistemologically complex
decision making structures.
26