designing breadth-oriented data exploration for mitigating cognitive biases · 2020. 5. 19. ·...

34
Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole

Upload: others

Post on 11-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Designing Breadth-Oriented Data Exploration for

Mitigating Cognitive Biases

Po-Ming LawRahul C. Basole

Page 2: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What is Breadth-Oriented Exploration?

Exploring more = Breadth?

2

Page 3: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Like Talking about A Large Apple…

How large is large?

3

Page 4: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Why Breadth in Data Exploration?

It is the purpose of exploratory data analysis!

“Exploratory data analysis is detective work.”John W. Tukey

4

Page 5: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

6

Where should I go after I graduate?

Page 6: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

7

AbidjanAfrica44442 33 2422445

BeijingAsia2113231122 1433

BangkokAsia2333132142 1441

CopenhagenEurope11211111121 121

DubaiMiddleEast11223222311 243

KievEurope3113222133 3 421

TehranMiddleEast23335532344 423

ZurichEurope1111111112 1122…

Page 7: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

8

Europe sounds like an awesome place!

Page 8: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

AthensEurope 12221121322322

BelgradeEurope 32232222331422

BarcelonaEurope 21211111121221

HamburgEurope 21111111111122

LondonEurope 21321111221111

OsloEurope 11111122111121

RomeEurope 21121111121321

StockholmEurope 11111121121121…9

Page 9: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

My subconscious mind

These cities look familiar to me and they get high scores.

Let me choose them.

10

Page 10: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

Amsterdam Europe212111111211 11

Berlin Europe21211111111 122

Barcelona Europe212111111212 21

Copenhagen Europe112111111211 21

Hamburg Europe211111111111 22

London Europe213211112211 11

Paris Europe21111111211211

Rome Europe21121111121321…11

Page 11: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

Missing lots of incredible cities…

12

Page 12: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

Budapest Europe211211112213 21

Frankfurt Europe212111111111 22

Dusseldorf Europe212111111111 22

Geneva Europe111111111211 22

Helsinki Europe111111211211 21

Lisbon Europe21121111221211

Oslo Europe11111122111 121

Reykjavik Europe111111222221 21…13

Page 13: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

Familiarity Heuristic

London Paris Rome

Oslo Dusseldorf Reykjavik

Familiar names:

Strange names:

>14

Page 14: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What Causes the Lack of Breadth?

15

Use of heuristics is a potential causeof lack of breadth in data exploration

Page 15: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Miss Insights

Lack of Breadth

Problem Solution

Heuristics

Information Overload

Show me the other cities I

might be interested in

16

Page 16: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What is Breadth-Oriented Exploration?

17

Exploring more = Breadth?

Page 17: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What is Breadth-Oriented Exploration?

18

Exploring more = Breadth?

A strategy to overcome lack of breadth in exploration due to information overload

Page 18: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

How do you design a system to overcome the lack of breadth?

Three Design Considerations:

Unit of ExplorationUser-driven vs System-driven ExplorationRelated vs Systematic Exploration

19

Page 19: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

First Consideration: Unit of Exploration

What things to which the system should exposeusers more?

Data case or dimension?

20

Page 20: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

21

We may want to look at different combinations of dimensions during exploratory data analysis

Terrorism

Censorship

Education

Page 21: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Exploring the unexplored

Education

ViolentCrimexTerrorism

AwarenessUnexplored

Education

ViolentCrimexTerrorism

Unexplored

Education

ViolentCrimexTerrorism

Use of Dimensionas a Unit of Exploration

22

1. Showing dimension coverage information

Explored

Terrorism

EducationxCensorship

Page 22: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Use of Dimensionas a Unit of Exploration

23

2. Showing new dimensions as you explore

User exploresTerrorism

Censorship

Terrorism

System recommends

Page 23: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Unit of Exploration

How does it apply to a system for exploring the city dataset?

24

Data case as a unit

Users explore cities System recommends cities

LondonParisRome

OsloDusseldorfReykjavik

Page 24: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Second Consideration: User-driven vs System-driven Exploration

25

Information about exploration

Awareness of exploration

Less-biased exploration

Users are responsible for ensuring breadth

Page 25: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Second Consideration: User-driven vs System-driven Exploration

26

Select information to show

Less-biased exploration

System is responsible for ensuring breadth

Page 26: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

User-driven vs System-driven Exploration

27

How does it apply to a system for exploring the city dataset? System-driven exploration

Users explore cities

LondonParisRome

OsloDusseldorfReykjavik

System recommends cities

Goal:toincreasebreadthofexploration

Page 27: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Third Consideration:Related vs Systematic Exploration

Only applies to system-driven exploration…

28

Showing something related but different

Page 28: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Third Consideration: Related vs Systematic Exploration

29

Some steps you should go through in data analysis

Holiday:

Work: NorthAmerica Asia Europe

Europe Australia NorthAmerica

Only applies to system-driven exploration…

Page 29: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Related vs Systematic Exploration

30

How does it apply to a system for exploring the city dataset? Related exploration

Users explore cities

LondonParisRome

OsloDusseldorfReykjavik

System recommends cities

Related

Goal:toincreasebreadthofexploration

Page 30: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What is Breadth-Oriented Exploration?

31

Exploring more = Breadth?

Strategy to overcome lack of breadth in exploration due to information overload

by overloading users with more information???

Page 31: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Paradoxical? Or… is it?Unit of Exploration

What to show

User-driven vs System-driven ExplorationWho is responsible to select

Related vs Systematic ExplorationBased on what to select

32

About information selection

About information selection

About information selection

Page 32: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

What is Breadth-Oriented Exploration?

33

Exploring more = Breadth?

Strategy to overcome lack of breadth in exploration due to information overload

by selecting potentially useful information to show

by overloading users with more information???

Page 33: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Sounds Challenging…

How to select to ensure relevance of information and prevent information overload?

34

Page 34: Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases · 2020. 5. 19. · Mitigating Cognitive Biases Po-Ming Law Rahul C. Basole. ... 12. What Causes the Lack

Designing Breadth-Oriented Data Exploration for Mitigating Cognitive Biases

Po-Ming Law

Rahul C. Basole

[email protected]