a task-based taxonomy of ognitive iases for information...
TRANSCRIPT
![Page 1: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/1.jpg)
A Task-based Taxonomy ofCognitive Biases for Information
VisualizationEvanthia Dimara, Steven Franconeri, Catherine Plaisant, Anastasia
Bezerianos, and Pierre Dragicevic
![Page 2: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/2.jpg)
Three kinds of limitations
The Computer The Display
2
![Page 3: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/3.jpg)
Three kinds of limitations
The Computer The Display The Human
3
![Page 4: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/4.jpg)
Three kinds of limitations: humans
The Human
• Human vision 👁️ has limitations
• Human reasoning 🧠has limitations
4
![Page 5: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/5.jpg)
👁️Perceptual bias
Magnitude estimation
5
![Page 6: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/6.jpg)
👁️Perceptual bias
Magnitude estimation Color perception
6
![Page 7: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/7.jpg)
🧠 Cognitive bias
Behaviors when humans consistently behave irrationally
Pohl’s criteria distilled:
• Are predictable and consistent
• People are unaware they’re doing them
• Are not misunderstandings
7
![Page 8: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/8.jpg)
Ambiguity effect, Anchoring or focalism, Anthropocentric thinking, Anthropomorphism or personification,Attentional bias, Attribute substitution, Automation bias, Availability heuristic, Availability cascade, Backfireeffect, Bandwagon effect, Base rate fallacy or Base rate neglect, Belief bias, Ben Franklin effect, Berkson'sparadox, Bias blind spot, Choice-supportive bias, Clustering illusion, Compassion fade, Confirmation bias,Congruence bias, Conjunction fallacy, Conservatism (belief revision), Continued influence effect, Contrasteffect, Courtesy bias, Curse of knowledge, Declinism, Decoy effect, Default effect, Denomination effect,Disposition effect, Distinction bias, Dread aversion, Dunning–Kruger effect, Duration neglect, Empathy gap,End-of-history illusion, Endowment effect, Exaggerated expectation, Experimenter's or expectation bias,Focusing effect, Forer effect or Barnum effect, Form function attribution bias, Framing effect, Frequencyillusion or Baader–Meinhof effect, Functional fixedness, Gambler's fallacy, Groupthink, Hard–easy effect,Hindsight bias, Hostile attribution bias, Hot-hand fallacy, Hyperbolic discounting, Identifiable victim effect, IKEAeffect, Illicit transference, Illusion of control, Illusion of validity, Illusory correlation, Illusory truth effect, Impactbias, Implicit association, Information bias, Insensitivity to sample size, Interoceptive bias, Irrational escalationor Escalation of commitment, Law of the instrument, Less-is-better effect, Look-elsewhere effect, Loss aversion,Mere exposure effect, Money illusion, Moral credential effect, Negativity bias or Negativity effect, Neglect ofprobability, Normalcy bias, Not invented here, Observer-expectancy effect, Omission bias, Optimism bias,Ostrich effect, Outcome bias, Overconfidence effect, Pareidolia, Pygmalion effect, Pessimism bias, Planningfallacy, Present bias, Pro-innovation bias, Projection bias, Pseudocertainty effect, Reactance, Reactivedevaluation, Recency illusion, Regressive bias, Restraint bias, Rhyme as reason effect, Risk compensation /Peltzman effect, Salience bias, Selection bias, Selective perception, Semmelweis reflex, Sexual overperceptionbias / sexual underperception bias, Singularity effect, Social comparison bias, Social desirability bias, Status quobias, Stereotyping, Subadditivity effect, Subjective validation, Surrogation, Survivorship bias, Time-saving bias,Third-person effect, Parkinson's law of triviality, Unit bias, Weber–Fechner law, Well travelled road effect,Women are wonderful effect, Zero-risk bias, Zero-sum bias
8
![Page 9: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/9.jpg)
This Paper’s Goals
• Provide a broad review of cognitive biases, for visualization researchers
• Layout the problem space to guide future studies that help designers anticipate limitations of human judgement
9
![Page 10: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/10.jpg)
Taxonomies of Cognitive BiasEssentially, the related work section
10
![Page 11: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/11.jpg)
Taxonomies of Cognitive Biases
• Explanatory taxonomies• A. Tversky and D. Kahneman, “Judgement Under Uncertainty: Heuristics and
Biases”
• J. Baron, Thinking and Deciding
• J. Evans, Hypothetical Thinking: Dual Processes in Reasoning and Hudgement
• K. Stanvoich, Rationality and the Reflective Mind
11
![Page 12: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/12.jpg)
12
![Page 13: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/13.jpg)
Taxonomies of Cognitive Biases
• Explanatory taxonomies• A. Tversky and D. Kahneman, “Judgement under uncertainty: Heuristics and
biases”
• J. Baron, Thinking and deciding
• J. Evans, Hypothetical thinking: Dual processes in reasoning and judgement
• K. Stanvoich, Rationality and the Reflective Mind
13
![Page 14: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/14.jpg)
Taxonomies of Cognitive Biases
• Explanatory taxonomies• A. Tversky and D. Kahneman, “Judgement under uncertainty: Heuristics and
biases”
• J. Baron, Thinking and deciding
• J. Evans, Hypothetical thinking: Dual processes in reasoning and judgement
• K. Stanvoich, Rationality and the Reflective Mind
• Taxonomies from decision-support• W. E. Remus and J. E. Kottemann, “Toward Intelligent Decision Support
Systems: An Artificially Intelligent Statistician.”
• D. Arnott, “Cognitive Biases and Decision Support Systems Development: a Design Science Approach”
14
![Page 15: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/15.jpg)
How they built their taxonomyThe methodology section
15
![Page 16: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/16.jpg)
How they built their taxonomy
16
![Page 17: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/17.jpg)
How they built their taxonomy
Step 1: Cross reference the biases with information visualization literature.
If vis literature exists
Step 2.a: Find the experiment study the vis paper cites for this bias
If no vis literature exists
Step 2.b: Look for any literature on the bias.
17
![Page 18: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/18.jpg)
18
![Page 19: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/19.jpg)
Their Task-Based TaxonomyTheir “Results” section
19
![Page 20: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/20.jpg)
20
Cognitive Biases by Task
![Page 21: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/21.jpg)
21
![Page 22: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/22.jpg)
22
Cognitive Biases by Flavor
![Page 23: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/23.jpg)
23
Cognitive Biases by Task
![Page 24: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/24.jpg)
24
Cognitive Biases by Task
![Page 25: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/25.jpg)
Biases in estimation tasks: a sample
Base rate fallacyWe overestimate the likelihood of an event.
Conjunction fallacyWe believe that specific events are more probable than general ones.
Optimism biasWe make more optimistic predictions about ourselves than other people.
25
![Page 26: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/26.jpg)
Biases in estimation tasks: in vis
Base rate fallacy: We overestimate the likelihood of an event.
Can visualization help?• Muddled results
26Micallef, et al. Assessing the Effect of Visualizations on Bayesian Reasoning Through Crowdsourcing
![Page 27: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/27.jpg)
Decision tasks biases: a sample
Attraction effectOur decision between two alternatives is influenced by the presence of inferior alternatives.
Ambiguity effectWe avoid decisions associated with ambiguous outcomes
IKEA effectWe like things we invest self-effort into more
27
![Page 28: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/28.jpg)
Decision tasks biases: attraction effect
Dimara, E. (2017). Information Visualization for Decision Making: Identifying Biases and Moving Beyond the Visual Analysis Paradigm.28
![Page 29: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/29.jpg)
Decision tasks biases: Attraction effect
Dimara, E. (2017). Information Visualization for Decision Making: Identifying Biases and Moving Beyond the Visual Analysis Paradigm.29
![Page 30: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/30.jpg)
Decision tasks biases: Attraction effect
The Gym Experiment The Bet Experiment
Dimara, et al. The Attraction Effect in Information Visualization30
![Page 31: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/31.jpg)
Hypothesis assessment tasks: a sample
Confirmation BiasWe favor evidence that confirm our initial hypotheses with ignoring disconfirming evidence
Illusory Truth EffectWe think propositions are true if repeatedly exposed to it
Illusory Correlation BiasWe consider relationships between variables that do not exists
31
![Page 32: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/32.jpg)
Hypothesis assessment tasks: Confirmation Bias
Wall, E et al. Warning, Bias May Occur: A Proposed Approach to Detecting Cognitive Bias in Interactive Visual Analytics.32
![Page 33: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/33.jpg)
Hypothesis assessment tasks: Confirmation Bias
Wall, E et al. Warning, Bias May Occur: A Proposed Approach to Detecting Cognitive Bias in Interactive Visual Analytics.
33
![Page 34: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/34.jpg)
Discussion
34
![Page 35: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/35.jpg)
My opinion
👍 Survey of cognitive biases that are relevant to visualization research
35
![Page 36: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/36.jpg)
My opinion
👍 Survey of cognitive biases that are relevant to visualization research
👌 Their taxonomy good but not great.
36
![Page 37: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/37.jpg)
Acknowledged Limitations
• Each bias was assigned a single category• One bias could exist in more than one task category.
• Only one person did the initial coding and sorting• But all authors reviewed the process
• “Deviations from reality” is a complex and controversial notion.• We haven’t proved that cognitive biases actually reflect irrationality.
37
![Page 38: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/38.jpg)
My opinion
👍 Survey of cognitive biases that are relevant to visualization research
👌 Their taxonomy good but not great.
38
![Page 39: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/39.jpg)
My opinion
👍 Survey of cognitive biases that are relevant to visualization research
👌 Their taxonomy good but not great
What’s the point of flavors?
39
![Page 40: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/40.jpg)
40
Cognitive Biases by Flavor
![Page 41: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/41.jpg)
My opinion
👍 Survey of cognitive biases that are relevant to visualization research
👌 Their taxonomy good but not great
What’s the point of flavors?
41
![Page 42: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/42.jpg)
My opinion
👍 Survey of cognitive biases that are relevant to visualization research
👌 Their taxonomy good but not great
What’s the point of flavors?
It’s another task taxonomy
42
![Page 43: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/43.jpg)
A Multi-Level Typology of Abstract Visualization Tasks
43
![Page 44: A Task-based Taxonomy of ognitive iases for Information ...tmm/courses/547-19/slides/steve-cognitivebiases.pdfTaxonomies of ognitive iases •Explanatorytaxonomies •A. Tversky and](https://reader035.vdocuments.us/reader035/viewer/2022071119/6017e811d11cd40d8f6b1d62/html5/thumbnails/44.jpg)
Questions
44