information overload and bad decisions - let's...

64
Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved. 1 Information Overload and Bad Decisions John Stevenson Tester Lets Test Conference 20-22 nd May 2013

Upload: others

Post on 10-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved. 1

Information Overload and Bad Decisions John Stevenson Tester

Lets Test Conference 20-22nd May 2013

Page 2: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

The Internet?

Page 3: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

Page 4: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

Page 5: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

Page 6: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

Welcome to the Internet!

Page 7: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

The Internet: Pictures of Cats, Unicorns and

Rainbows! #LetsTest

A TWEET MOMENT!

Page 8: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

Agenda

Page 9: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

What is

Information

Overload?

Page 10: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

Fooled Ya!

Page 11: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

What has this

to do

with testing?

Page 12: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12

What can

we do?

Page 13: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13

Q & A

Page 14: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14

D. Allen and T. D. Wilson,

“Information overload: Context and causes”

Information overload occurs

when the information available

exceeds the user's ability to

process it

Page 15: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15

Page 16: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16

Page 17: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17

Page 18: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18

The human brain can store about 3 Terabytes

of info this is less than 1 millionth of the

information being produced each day.

#LetsTest

A TWEET MOMENT!

Page 19: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19

Page 20: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20

Future Shock – Alvin Toffler

We have a limited capacity

Page 21: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21

Future Shock – Alvin Toffler

It has been seen that

overloading leads to a serious

breakdown of performance

(sometimes with dangerous

results)

Page 22: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22

Future Shock – Alvin Toffler

We are, in other words, forcing

them to process information at

a far more rapid pace than was

necessary in slowly-evolving

societies.

Page 23: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23

Future Shock – Alvin Toffler

There can be little doubt that

we are subjecting at least some

of them to cognitive

overstimulation.

Page 24: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24

Future Shock – Alvin Toffler 1972

What consequences this may

have for mental health in the

techno-societies has yet to be

determined.

Page 25: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25

Information overload could prove to be bad

for our mental health - Future Shock - Alvin

Toffler (1972) #LetsTest

A TWEET MOMENT!

Page 26: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26

AUDIENCE participation time!

Page 27: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27

What do you see?

Page 28: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28

You Are Not So Smart: Why You Have Too Many Friends on

Facebook, Why Your Memory Is Mostly Fiction, and 46 Other Ways

You're Deluding Yourself (David McRaney)

.. your brain hates ambiguity and is

willing to take shortcuts to remove it

from any situation. If there is nothing

else to go on, you will use what is

available. When pattern recognition

fails, you create patterns of your own.

Page 29: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29

When pattern recognition fails, you create

patterns of your own - You Are Not So Smart -

David McRaney #LetsTest

A TWEET MOMENT!

Page 30: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30

Numbers Joke: Did you hear about the

statistician who drowned whilst crossing a

river which had an average depth of 3 foot.

#LetsTest

A TWEET MOMENT!

Page 31: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31

Numbers need a story!

Page 32: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32

Telling the story of

numbers is vital.

Page 33: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33

Using only numbers to

measure WILL measure

the wrong thing!

Page 34: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34

Noticing and missing things

Page 35: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35

Page 36: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36

Survey Results

.

How many animals did Moses take in the ark?

Page 37: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37

Anchoring/Priming

Do not rely only on

the requirements

Page 38: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38

Using only requirements for #testing can

limit your thinking #LetsTest

A TWEET MOMENT!

Page 39: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39

How does this

relate to testing?

Page 40: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40

We base our testing

decisions on our

biases and ‘quick’

judgements

Page 41: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41

We create patterns

from our tests where

no patterns may exist

Page 42: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42

we ‘by design’ follow

the path of least

resistance with our

thinking

Page 43: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43

We make irrational

quick choices that

we are unaware we

are making.

Page 44: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 44

When we are faced

with too much

information we may not

be able to make

decisions

Page 45: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 45

Information, the very thing that makes it

possible to be an engineer.. is threatening

our ability to do our work. IEEE Spectrum

#LetsTest

A TWEET MOMENT!

Page 46: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 46

We constantly fail to

apply critical thinking

to our testing.

Page 47: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 47

Huh?

Really?

So?

James Bach

Page 48: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 48

What can we do?

Page 49: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 49

http://tomstuart.org/wp-content/uploads/2011/08/Danger-Slow-Down-Sign.jpg

Page 50: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 50

http://rlv.zcache.com/think_critically_stickers-p217225515567037288bahz5_400.jpg

Page 51: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 51

We need to step back from the constant

stream of info and devote time to creative

thinking and careful consideration D. Levy

#LetsTest

A TWEET MOMENT!

Page 52: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 52

Do not fear mistakes

http://1.bp.blogspot.com/-

m56Ctbp1QRs/T540KHgccfI/AAAAAAAAAiQ/Cnq4jMn

-rgQ/s400/mistakes%2B2.jpg

Page 53: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 53

but do learn from

them.

Page 54: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 54

Be aware that you are

human and therefore

fallible

Page 55: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 55

Learn by doing

http://4.bp.blogspot.com/_b_-xQ0LmXk4/SID3wJrtVZI/AAAAAAAAAV8/HD3fwC6x-

Kc/s400/Children+learn+by+doing-inspiredmommiedesigns.png

Page 56: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 56

Have a PASSION for

testing

Page 57: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 57

http://rrrrun.com/wp-content/uploads/2012/02/passion_rrrrun.com_.jpg

Page 58: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 58

Nothing great has been & nothing great can

be accomplished without PASSION – GWF

Hegel . #LetsTest #quote

A TWEET MOMENT!

Page 59: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 59

Information, the very thing that makes it

possible to be an engineer.. is threatening

our ability to do our work. IEEE Spectrum

#LetsTest #Irony

A TWEET MOMENT!

Page 60: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

Thank you. Thank you.

Page 61: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

Cisco Confidential © 2011 Cisco and/or its affiliates. All rights reserved. 61

Slide #61

• Links/References

• http://www.sizes.com/people/brain.htm

• http://www.amazon.co.uk/The-Signal-Noise-Science-Prediction/dp/1846147522/

• http://www.spinachandyoga.com/how-to-navigate-overabundance-of-health-and-wellness-information/

• http://www.theinvisiblegorilla.com/

• http://www.amazon.co.uk/Future-Shock-Alvin-Toffler/dp/0808501526

• http://www.amazon.com/Asking-Right-Questions-Critical-MyCompLab/dp/0205111165

• James Bach: http://www.satisfice.com/blog/

• Little Bets - Peter Sims: http://www.amazon.com/Little-Bets-Breakthrough-Emerge-Discoveries/dp/1439170428

• Everything is Obvious - Duncan J. Watts: http://www.amazon.co.uk/Everything-is-Obvious-ebook/dp/B00556G7RY/

• Information Overload: An International Challenge for Professional Engineers and Technical Communicators -

• http://www.amazon.co.uk/Information-Overload-International-Communicators-Communication/dp/1118230132

• http://spectrum.ieee.org/computing/it/how-to-beat-information-overload

• http://boydio.wordpress.com/

• http://iorgforum.org/

Page 62: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

Cisco Confidential © 2011 Cisco and/or its affiliates. All rights reserved. 62

Slide #62

• James Bach

• Michael Bolton

• Rob Lambert

Page 63: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

Cisco Confidential © 2011 Cisco and/or its affiliates. All rights reserved. 63

Slide #63

John Stevenson

@steveo1967

www.steveo1967.blogspot.com

[email protected]

Page 64: Information Overload and Bad Decisions - Let's Testlets-test.com/wp-content/uploads/2013/06/Information...You Are Not So Smart: Why You Have Too Many Friends on Facebook, Why Your

Cisco Confidential © 2011 Cisco and/or its affiliates. All rights reserved. 64

Slide #64