test automation is dead. long live test automation!sddconf.com › brands › sdd › library ›...
TRANSCRIPT
Test automation is dead. Long live test automation!
Seb Rose
Agenda
• Introduction • Traditional test automation • A new hope • Long live test automation!
@sebrose [email protected]
Le roi est mort, vive le roi!The phrase arose from the law of
le mort saisit le vif—that the transfer of sovereignty occurs
instantaneously upon the moment of death of the previous monarch.
h>ps://en.wikipedia.org/wiki/The_king_is_dead,_long_live_the_king!
@sebrose [email protected]
“a process of gathering informa3on about [so7ware] with the intent that the
informa3on could be used for some purpose”
What is testing?
Gerry Weinberg Perfect So7ware and Other Illusions About Tes3ng
@sebrose [email protected]
What is automation?
• the technique of making an apparatus, a process, or a system operate automatically
• the state of being operated automatically
• automatically controlled operation of an apparatus, process, or system by mechanical or electronic devices that take the place of human labor
h>p://www.merriam-webster.com/dicHonary/automaHon
Agenda
• Introduction • Traditional test automation • A new hope • Long live test automation!
@sebrose [email protected]
Traditional rationale• Independent of developer efforts • Equivalence partitioning etc.
• We’re testing quality “in” • Checking that there are no defects • Automated tests accelerate regression testing
• Various techniques to reduce quantity
@sebrose [email protected]
Given I am an authenticated user with an admin roleAnd a client "test client" exists with name: "test client", initials: "TTC"And a project "test project" exists with name: "test project", client: client "test client"And a ticket "test ticket" exists with project: project "test project", name: "test ticket"And a work_unit "test work unit" exists with ticket: ticket "test ticket", scheduled_at: "2010-01-01", hours: "1"And I am on the admin invoices pageThen I should see "test client"And I follow "test client"And I fill in "global_invoiced" with "123"And I press "Submit"Given I am on the admin invoices pageThen I should not see "test client"
Agenda
• Introduction • Traditional test automation • A new hope • Long live test automation!
@sebrose [email protected]
h>p:
//lis
acris
pin.
com
/201
1/11
/08/
usin
g-th
e-ag
ile-t
esHn
g-qu
adra
nts/Agile testing quadrants
@sebrose [email protected]
OOPSI
h>ps
://je
nnyj
mar
.com
/201
6/04
/16/
bdd-
disc
over
y-an
d-oo
psi/
@sebrose [email protected]
Example mapping
h>ps
://cu
cum
ber.i
o/bl
og/2
015/
12/0
8/ex
ampl
e-m
appi
ng-in
trod
ucHo
n
@sebrose [email protected]
There are known knowns; there are things we know that we know.
There are known unknowns; that is to say there are things that, we now know we don't know.
But there are also unknown unknowns – there are things we do not know we don't know.
@sebrose [email protected]
Living documentation
h>ps
://re
lisha
pp.c
om/G
DS/
whi
teha
ll/do
cs/h
istor
ical
-acc
ount
s
@sebrose [email protected]
Feature: Feature name Descrip3on of feature goes here
Scenario: Scenario name Descrip3on of scenario goes here
Given a certain context When something happens Then an outcome And something else But not this though
Scenario: Another scenario name Descrip3on of another scenario goes here ...
Gherkin
@sebrose [email protected]
Bene
fit (R
isk)
Cost
Invest in infrastructure
Pointless
Highvalue
Bread & bu>er
Costs and benefits
@sebrose [email protected]
h>p://claysnow.co.uk/architectural-alignment-and-test-induced-design-damage-fallacy/
Test automation pyramid
Manual / Exploratory
@sebrose [email protected]
[We] write code that reflects the language the stakeholder used to describe the his needs. Simply put, we would try to make our code as close as technically possible to the conversa3on we had.
KonstanHn Kudryashov
Modelling by example
h>p://stakeholderwhisperer.com/posts/2014/10/introducing-modelling-by-example
@sebrose [email protected]
Be>er communicaHon
(Ubiquitous language)Reduced risk (Faster feedback)
Increased trust
(CollaboraHon)Living documentaHon
Long live test
automa;on!
