how to test the inside of your head
DESCRIPTION
Selenium Conference keynote on cognitive bias, testing and Martians.TRANSCRIPT
![Page 1: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/1.jpg)
Liz Keogh
@lunivore
![Page 2: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/2.jpg)
A story because we all love
sleeping
![Page 3: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/3.jpg)
Observe data
Filter data
Generate assumptions
Draw conclusions
Build beliefs
![Page 4: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/4.jpg)
![Page 5: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/5.jpg)
Cydonia, Viking 1, 1976
![Page 6: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/6.jpg)
Cydonia, Viking 1, 1976
![Page 7: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/7.jpg)
![Page 8: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/8.jpg)
![Page 9: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/9.jpg)
![Page 10: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/10.jpg)
![Page 11: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/11.jpg)
Scenarios
Given a context
When an event happens
Then an outcome should occur
![Page 12: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/12.jpg)
Examples
Given Fred has bought a microwave
And the microwave cost £100
When we refund the microwave
Then Fred should be refunded £100.
![Page 13: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/13.jpg)
Is there a context in which this event will create a different outcome?
Context Questioning
![Page 14: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/14.jpg)
Cydonia, Mars Reconnaisance Orbiter, 2006
![Page 15: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/15.jpg)
Martian channels by Percival Lowell
![Page 16: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/16.jpg)
Confirmation Bias
Think we’re right
Look for validation Feel really good!
![Page 17: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/17.jpg)
Confirmation Bias
Think we’re right
Find out we’re not Boo!
![Page 18: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/18.jpg)
Google effect
Apophenia Pareidolia
Confirmation Bias
Actor-Observer
Bias
Illusion of Control
Insensitivity to sample
size
Omission bias
Negativity bias
Naïve cynicism
Fundamental Attribution
Error
System justification
Worse-than-average effect
Illusion of transparency
Trait ascryption
bias
Cryptomnesia
Choice-supportive
bias Forer effect
Normalcy bias
Bandwagon effect
Decoy effect
Hyperbolic discounting
Restraint bias
Stereotyping
Distinction bias
Pseudocertainty effect
Pessimism bias
Optimism bias
Moral luck
False consensus
effect
Anchoring
Congruence bias
Overconfidence effect
Loss Aversion
159 Cognitive Biases on Wikipedia
![Page 19: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/19.jpg)
Observe data
Filter data
Generate assumptions
Draw conclusions
Build beliefs
![Page 20: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/20.jpg)
![Page 21: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/21.jpg)
Scenarios
Given a context
When an event happens
Then an outcome should occur
![Page 22: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/22.jpg)
Traditional
Rework
Developers Testers
Deliberate Discovery skills
![Page 23: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/23.jpg)
Behavior Driven Development
Less Rework
Developers Testers
Deliberate Discovery skills
Testers
![Page 24: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/24.jpg)
Is there a context in which this event will create a different outcome?
Context Questioning
![Page 25: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/25.jpg)
Is this the only outcome that matters?
Outcome Questioning
![Page 26: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/26.jpg)
Options have value.
Options expire.
Never commit early unless you know why.
![Page 27: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/27.jpg)
The Huddle
Developer
![Page 28: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/28.jpg)
![Page 29: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/29.jpg)
Is there a different context which might have produced
this outcome?
Assumption Questioning
![Page 30: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/30.jpg)
![Page 31: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/31.jpg)
![Page 32: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/32.jpg)
![Page 33: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/33.jpg)
“Nobody loves me.”
![Page 34: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/34.jpg)
![Page 35: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/35.jpg)
![Page 36: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/36.jpg)
A story because we all love
sleeping
![Page 37: How to test the inside of your head](https://reader033.vdocuments.us/reader033/viewer/2022061201/5479841ab37959532b8b47a4/html5/thumbnails/37.jpg)
Liz Keogh [email protected] @lunivore