improve your test process from the bottom up
TRANSCRIPT
4/23/15
1
Test Proces Improvement Bottom-Up
Gitte Ottosen [email protected]
godtesen
© CapgeminiSogeti
A Bit About Me
2
Gitte Ottosen Managing Consultant Capgemini Sogeti Danmark A/S [email protected] +45 52 18 97 11 Twitter: godtesen
Education Corperal Royal Danish Airforce Certifications: SCRUM master, ISEB foundation/practitioner, CAT trainer, TMap Test Engineer, TPI Next foundation
Employment 20 years within testing 3 years in Capgemini Sogeti Denmark
Experience Test management, Test engineering, process improvement, CMMI, agile, context driven testing, change management Agile Experience Maersk Line IT, DONG, KMD, Systematic, public sector Network Test20/Tecpoint, CAT trainer network Fellow Sogeti Labs
4/23/15
2
Models and Theory
3
© CapgeminiSogeti
Test Process Improvement - TMMI
4
4/23/15
3
© CapgeminiSogeti
Test Process Improvement - TPI Next
5
© CapgeminiSogeti
A Few Quotes and Definitions
Change management is a structured approach for ensuring that changes are thoroughly and smoothly implemented, and that the lasting benefits of change are achieved.
Mind tools
The hardest part of continuous improvement in organizations is changing the behavior of other people.
Jurgen Appelo
6
4/23/15
4
© CapgeminiSogeti
PDCA: Plan – Do – Check - Act
http://www.mindtools.com http://www.management30.com
7
© CapgeminiSogeti
ADKAR
• Awareness • Desire • Knowledge • Ability • Reinforcement
http://www.change-management.com http://www.management30.com
8
4/23/15
5
© CapgeminiSogeti
How to Eat an Elephant...
9
One bite at the time!
The Context
10
4/23/15
6
© CapgeminiSogeti
The Context of the Case
11
The Case
Domain
Organisation
Culture
IT Test competences
SDLC
Contract
Vendors
© CapgeminiSogeti
The Organization and the People
• People – Product ownership – clinicial background – Test and support team – clinical background – No test specialists
• Organization – Inmature organization – Organizational change – New leadership/management – No defined processes – No clear communication lines
• Environment – Politically controlled
12
4/23/15
7
© CapgeminiSogeti
Testing Challenges
Early days of test planning
System test – mindmaps
Primarally functionality focus
System integration test – nothing
Performance test – limited
Usability – only implicit
Depending on individuals
Defect tracking - inconsistent 13
What We Did
14
4/23/15
8
© CapgeminiSogeti
Different Ways to Do It
15
© CapgeminiSogeti
Getting Started
• The as-is proces, getting it described – Different stakeholders - internal – The flow – The challenges – Dreams and wishes – Brownpaper
16
4/23/15
9
© CapgeminiSogeti
Introducing Swimlanes – as is proces
17
© CapgeminiSogeti
Ensuring Involvement and Ownership
• Involve other stakeholders than test
• Discus outcome of initial drawing
• Amend with input • Agree on current proces
18
4/23/15
10
© CapgeminiSogeti
Getting a Common Test Language
• Inernal Training – Basic test – Test design techniques – Everybody get the training
• Pairing – A trained tester – Clinical tester – Clinical product owner
19
© CapgeminiSogeti
Getting a Bit Structured
Breaking down the system in modules, submodules, areas
Involving test early?
Moving the focus from functionality to clinical usage
A better test coverage
Test design technique with workflow focus
Knowledge sharing
Workshop on test design
20
4/23/15
11
© CapgeminiSogeti
Process Cycle Test
21
1-2-8 1-3-4-6-8 1-3-5-7-8-9
EP + BVA?
© CapgeminiSogeti
Getting a Better Overview
• From Excel to Testrail
22
4/23/15
12
© CapgeminiSogeti
Tooling up
23
© CapgeminiSogeti
Involving the Vendors
• Joint workshop • Identifying easy wins
24
4/23/15
13
© CapgeminiSogeti
From Many Systems to One
• Before: – Defects reported in vendors systems – Minimum 3-4 different systems – Each defect reported in two systems – Internal defects not reported, just mail/phone – No common picture
• Change: – One defect management system – Vendor access to defect management system – All defects are reported
25
© CapgeminiSogeti
Getting the Risk Focus
26
Likelihood
Impact
4/23/15
14
© CapgeminiSogeti
Product Risk Analysis – The Tmap Way
27
Test goal Characteristic Damage Chance of Failure
Risk Class
Feature 1 Functionality H H A User-friendliness M L C
Feature 2 Functionality M M B Security H M B
Feature 3 Functionality M L C Feature 4 Performance M L C Risk X Performance L L C
Risk Y Functionality M M B Suitability M M B
.. .. .. .. ..
© CapgeminiSogeti
Test Planning – A Joint Venture
28
Scope presentation
Risk assessment
Test plan draft
Test plan review
Testers Product owners Techical specialists
4/23/15
15
© CapgeminiSogeti
Test Involved Earlier
29
From here
To here
© CapgeminiSogeti
Supporting Others
• Other Projects – Test managment – Test design – Test execution
• System Integration Test – Test tree – Test design
• Technical test – Test tree – Test design
30
4/23/15
16
© CapgeminiSogeti
Status Today
31
© CapgeminiSogeti
Thank You
32