disruptive testing with anne-marie charrett
DESCRIPTION
New technologies and a need for innovation mean we test within a rapidly changing and evolving environment. But no matter how much we estimate and plan, something seems to throw these plans into chaos. Agile helps us to minimise this disruption through an iterative and incremental approach but regardless we seems to get surprised and frustrated by change. Nassim Nicholas Taleb argues that much of what we do lives in Black Swan territory. A black swan is a metaphor for an unpredictable event that in hindsight was preventable. Sound familiar? Software testing is the ultimate black swan challenge. Our very role is to search for unpredictable events. The irony is that in the process of hunting for these black swans, our testing itself becomes the target of black swans! For example, development takes longer than anticipated, business change their minds and bug retesting takes longer than hoped. These black swans impact our ability to accurately estimate and plan. Taleb argues that instead of attempting to improve prediction we are better off developing a more robust approach to change. It’s time for a rethink in testing. It’s time to change our approach from one of control to one that embraces disruption. One in which testing becomes stronger and more valuable as a result of change. But how? The key lies in developing a testing mindset and developing tester skill. In this talk I will discuss how to helps testers become expert black swan hunters and how to develop a testing process that embraces disruption and welcomes change. www.eurostarconferences.com www.testhuddle.comTRANSCRIPT
C O PYR I G H T 20 14 A C H A R R E TT
D I S R U P T I V E T E S T I N G
A N N E - M AR I E C H A R R E TTT E S T I N G T I M E S
C O PYR I G H T 20 14 A C H A R R E TT
M U N S T E R V S A L L BL AC K S
1978
@ C HA R R ETT
@ C HA R R ETT
T Y P I CAL T E S T P R OCE S S
Test Plan Test SpecTest ExecutionTest Report
@ C HA R R ETT
C O PYR I G H T 20 14 A C H A R R E TT
D E T E R M I N A S T IC T E S T I N G
• Meticulous adherence to test process
• Try and predict precise estimates
• Try and predict number of bugs to be found
• Lock down mentality
@ C HA R R ETT C OPY R I G HT R ON K R OET Z
C O PYR I G H T 20 14 A C H A R R E TT
N A S S I M N I C HOL A S TA LEB
“The black swan theory or theory of black swan events is a metaphor that describes an event that comes as a surprise, has a major
effect, and is often inappropriately rationalized after the fact with the benefit of
hindsight. ”
C O PYR I G H T 20 14 A C H A R R E TT
BEN T F LY V B J ER G & A LEXA N D ER BUD Z I ER , S EP T EM BER 2011 , " W HY YOUR I T P R O J EC T M AY BE
R I S K I ER THA N YOU TH I N K " , HA RVA R D BUS I N ES S R EV I EW
“average cost of IT projects overrun is only 27%”
“1 in six had a cost overrun of 200% and a schedule overrun of almost 70%.”
C O PYR I G H T 20 14 A C H A R R E TT
AVO I D P R E D I C T I O N
C O PYR I G H T 20 14 A C H A R R E TT
B E C O M E R O B U S T
C O PYR I G H T 20 14 A C H A R R E TT
W E FOC US ON TES T I N G , W E F OC US ON S K I LL .
- M I C HA EL BOLT ON
FOCUS ON ORGANIZATIONS AND INDIVIDUALS THAT ARE PREPARED & EMPOWERED TO DEAL MENTALLY, POLITICALLY, AND EMOTIONALLY
WITH SURPRISES
C O PYR I G H T 20 14 A C H A R R E TT
T O O L S
T E S T I N G
P R O C E S S
C O PYR I G H T 20 14 A C H A R R E TT
C O PYR I G H T 20 14 A C H A R R E TT
T H E AG E O F T H E T H I N K I N G T E S T E R
C O PYR I G H T 20 14 A C H A R R E TT
T H I N K I N G T E S T E R
• CRITICAL THINKING
• LATERAL THINKING
• COMPLEXITY
• COMMUNICATION
C OPY R I G HT BY R OM A N J OOS T
• Embrace Technology
• Join a community
• Look beyond your community
• Develop testing skills
• Study Testing and Development
• Develop an opinion
• Speak about Testing
• Write about Testing C O PYR I G H T 20 14 A C H A R R E TT
C O PYR I G H T 20 14 A C H A R R E TT
H A B I TAT
C O PYR I G H T 20 14 A C H A R R E TT
C O N D I T I O N S
• AUTONOMY
• COLLABORATION
• CONTINUOUS SELF LEARNING
• EMPOWERMENT
• SAFETY
C O PYR I G H T 20 14 A C H A R R E TT
- C EM KA N ER
“Exploratory testing is an approach to software testing that is concisely described as simultaneous learning, test design and
test execution.”
C O PYR I G H T 20 14 A C H A R R E TT
T E S T E R C E N T R I C
DesignTesting
Learning
AutodidacticSelf Awareness
AutonomyCourage
Mental Engagement
P R O C E S S
• You are buying three items at a shop. These are the prices:
• $19.95
• $39.98
• $29.97
About how much money are you spending?
C O PYR I G H T 20 14 A C H A R R E TT
H E U R I S T I C S
A heuristic is a fallible method of solving a problem or making a decision.
• Requires skill
• Context Dependent
• Less Visible
C OPY R I G HT S OR EN S I I M
James Bach
C O PYR I G H T 20 14 A C H A R R E TT
– M I C HA EL BOLTON
“we can expect the unpredictable, anticipate it to some degree, manage it as best we
can, and learn from the experience.”
W E C A N N O T P R E D I C T T H E U N PR E D I C TA BL E
C O PYR I G H T 20 14 A C H A R R E TT
R E A D I N G
• The Black Swan - NN Taleb
• Antifragile - NN Taleb
• General Systems Thinking - J.Weinberg
• Black Swan & Testing blog series - Michael Bolton
• Heuristics & Testing - James Bach, Michael Bolton, Cem Kaner, James Lyndsey and any context driven tester you know of.
C O PYR I G H T 20 14 A C H A R R E TT
T H A N K YO U
AVA I L A BLE F OR
TRA I N I N G , C OAC H I N G & C ON S ULT I N G
A M C HA R R ETT@ T ES T I N GT I M ES . C OM . A U
C O PYR I G H T 20 14 A C H A R R E TT
A N Y Q U E S T I O N S ?