i'm looking at you to tell me, should i automate v10
DESCRIPTION
"I am going to tell you two things in this presentation. One: As test professionals we have the responsibility to introduce test automation to our organization, because TA is inevitable. Two in order to convince management we need to quantize the benefits of doing so..." These were my starting lines of my presentation I gave at the test automation day held on 20 June 2013. See my slides for my ideas in how to do so…TRANSCRIPT
![Page 1: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/1.jpg)
I’m looking at you to tell me…
Derk-Jan de GroodTest Automation Day 2013
1
Should I Automate ?
![Page 2: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/2.jpg)
Our old and new approach
2
![Page 3: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/3.jpg)
Reasonable arguments
Economics
BR
IC
Increasing complexityC
ontin
ues
Del
iver
y
Shorter life cycle
Differentiation devices
Virt
ualiz
atio
n
SC
RU
M
Data mining
TiP
Test Design tools
Next generation
![Page 4: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/4.jpg)
TA is inevitable
4
![Page 5: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/5.jpg)
5
…and that summarizes why we should do TA
All well, but what is the financial impact ?
![Page 6: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/6.jpg)
Message
6
Quantising benefits of TA is a
necessity
Its our task to get organisation to start with TA
![Page 7: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/7.jpg)
7
You still do manual tests ?
![Page 8: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/8.jpg)
Perceived benefits
8
![Page 9: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/9.jpg)
Where does it hurt?
CoverageThroughput time (time to market)Variance in executionCosts
![Page 10: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/10.jpg)
10
You told me testing would be fast
Yeah, but we test twice as much now
![Page 11: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/11.jpg)
We want it all….
Succes stories are written in chapters….
Make a step plan
One goal for each step
A calculated benefit for each step
11
![Page 12: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/12.jpg)
Quantizise
Cost of Bugs in production
Cost of go-live slippage
Cost of testing activities
12
Best
Guess
![Page 13: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/13.jpg)
Business case
The cost of benefits of TA
13
![Page 14: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/14.jpg)
Embedding TA in organisation
14
![Page 15: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/15.jpg)
Vision
The need
The Goals
Tool preference
Outsourcing
Measurement of succes
15
Regression test Backlog
esting new functionality in e.g. projects
Design
ScriptsAction wordsDataInfrastructure/Framework
![Page 16: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/16.jpg)
Questions that drive the BC
16Does the solution fit the vision?
What is expected PayBack period?
What is expected profit?
What does automating these tests cost?
What TA solutions are already in place?
What does this mean for the tool requirements?
What charactizes these test technically?
Automation of what tests yield most benefit?
What tests are executed?
Think out of the box!
Scenario’s
Tailor made
solutions
Technical clustering
![Page 17: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/17.jpg)
Window(loket model)
17
![Page 18: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/18.jpg)
Scenario’s
18
Set-up
• Tool/partner selection• Planning
Backlog
• Automating testcases• Testing the testcases
operational
• Executing• Updating
operation
al
• Executing • Updating
![Page 19: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/19.jpg)
Estimate
Nr of releases/builds
The impact of planned changes (project portefolio)
Time to script a e.g. usecase
Define classes/action words
Create batches
Control various co-operating tools
Collect data from various tools
Set-up a reporting shell
Define and validate data
19
operational
• Executing• Updating
![Page 20: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/20.jpg)
Estimate
PoC
Licence costs
Resources organizing the Set-up
Setting up a measurement program
20
Set-up
• Tool/partner selection• Planning
Backlog
• Automating testcases• Testing the testcases
Finalizing test
Setting up interfaces
Hooking on to Build and config management
Etc..
![Page 21: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/21.jpg)
If you can’t predict….
21
![Page 22: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/22.jpg)
Window not effective?
22
![Page 23: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/23.jpg)
Session on TADAY 2012
23
1 NeedsWhy automate testing?
2 DefineWhat tests should be automated, Reuse existing test or define new tests
3 PreconditionsInfrastructure and tool selection. These are the technical constraints that need to be in order to be able to automate filled.4 Usage Embedding of test automation into existing processes necessary.5 OrganizationAre resources and knowledge available?
![Page 24: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/24.jpg)
Window not effective
24
![Page 25: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/25.jpg)
Other models
26
![Page 26: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/26.jpg)
ROI model
27
The ROI depend on the number of
excutions and the amount of
maintance required to do so
Change the model: Move from maintance to instant benefit.
![Page 27: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/27.jpg)
Pre-Condition
28
![Page 28: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/28.jpg)
Message generator
29
![Page 29: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/29.jpg)
30
Mirror (stub)
![Page 30: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/30.jpg)
Test mokey
Ask John Fodeh !
31
![Page 31: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/31.jpg)
32
![Page 32: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/32.jpg)
Remember the questions
33
![Page 33: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/33.jpg)
Get started !
![Page 34: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/34.jpg)
Wrap up
35
![Page 35: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/35.jpg)
Wrap up
36
![Page 36: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/36.jpg)
Downloads
37
http://djdegrood.wordpress.com/2013/05/15/test-automation-is-inevitable-mind-map/
http://djdegrood.wordpress.com/2012/06/22/test-automation-day-should-we-do-ta/
http://wp.me/a1AlVM-ei
![Page 37: I'm looking at you to tell me, should I automate v10](https://reader034.vdocuments.us/reader034/viewer/2022051322/5466ac05af795917078b5df1/html5/thumbnails/37.jpg)
Derk-Jan
ValoriColtbaan 4a3439 NG NIEUWEGEINThe Netherlands
• [email protected]• +31(0)651807878• www.valori.nl• @DerkJanDeGrood• http://djdegrood.wordpress.com
Derk-Jan
38
Succes with getting started !