measurement magic in world of devops
TRANSCRIPT
![Page 1: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/1.jpg)
Kai Jokiniemi
https://fi.linkedin.com/in/kaijokiniemi
Magic of Measurement
![Page 2: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/2.jpg)
Why?
Things are complicated.and faster.
One common misinterpretation / misuse: Bucks say “IT is not / achieving… “ It needs all to do it.
Need for information Ø As a basis for decisions Ø Gain situational view Ø in order to improve
![Page 3: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/3.jpg)
WHAT IT IS ALL ABOUT?
Be aware of that, because it causes pitfalls• Measure test case amount, you will get cases but how about
usefulness?• Measure found faults, you will get faults reported but how about
usefulness?
Different view points and needs exists.
WHAT YOU MEASURE IS WHAT YOU GET
![Page 4: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/4.jpg)
Learning
DELIVER
define
developmeasure
![Page 5: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/5.jpg)
develop
measure
analyzeimprove
control
TRACK
Knowledge
![Page 6: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/6.jpg)
develop
measure
analyze
improve control
DRIVE
Understanding
![Page 7: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/7.jpg)
Is there something alarming?
![Page 8: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/8.jpg)
Different aspects
Development Operations Finance
$
$
$
$
$$
$
$
$$
![Page 9: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/9.jpg)
Different aspects
Development
![Page 10: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/10.jpg)
Different aspects
Development
![Page 11: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/11.jpg)
Different aspects
Development
![Page 12: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/12.jpg)
Different aspects
Development
DoR - Definition of ReadyDoD - Definition of DoneDtP - Deployed to Production
Definition of
Ready
Definitionof
Done
Deployedto
ProductionBugs and
other feedback
ThingstoDo
Inputsfrom…
Coverage
DELIVER
![Page 13: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/13.jpg)
Fillrate/TTIDoR100%
80%
Fillrate/TTIDoD100%
80%
Fillrate/TTIDtP100%
80%
#ToDoIssues
Time
#Bugs
Map with coverage
DoR - Definition of ReadyDoD - Definition of DoneDtP - Deployed to Production
Time Time
Coverage
DELIVER
![Page 14: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/14.jpg)
Different aspects
OperationsThroughput
Services 92,1 %
CPU
Memory
Storage
TRACK
DELIVER
![Page 15: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/15.jpg)
Orchestration
TRACK
DELIVER
![Page 16: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/16.jpg)
![Page 17: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/17.jpg)
Different aspects
Finance
Published feature amount vs actual sold.
Feature expected value vs realized value.• Story point amount per time equals money.• Invested money amount needs to be smaller than gained.• There needs to be known feature money forecast AND measure outcome against that. • In case not fulfilling, change.
TRACK
DELIVER
DRIVE
![Page 18: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/18.jpg)
Different aspects
TRACK
DELIVER
DRIVE
DevelopmentØ Issues story point amount vs velocity (per
time)ü Bugs eats out development velocity =>
prediction
Ø probability indication: build success rate VS story point amount correlation and tests found bug fix average time
PredictabilityØ Gaining predictability: actual story
point per sprint vs velocity vs planned sp
Ø Fault amount - fix time Ø Fault hit rate vs coverage
Ø Failure rate - Fix timeØ CoverageØ Security vulnerabilitiesØ Code analysisØ Cycle time
Ø Service level Deployment succes rate Deployment recovery time
Ø Published features amount per month Deployment frequency
Ø Published feature amount vs actual sold Feature expected value vs realized value
![Page 19: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/19.jpg)
deliver
drive
track
View point
deliverdrive
track
View point
deliver
drive
track
View point
deliver
drive
track
View point
![Page 20: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/20.jpg)
SERVICE JAMTM
![Page 21: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/21.jpg)
deliver
drive
trackView point
Meanwhile
deliver
drive
trackView point
deliver
drive
trackView point
deliver
drive
trackView point
How to deal data volumes?
Automate
Machine learning
![Page 22: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/22.jpg)
Machine learning
effective with tons of logs
Especially
![Page 23: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/23.jpg)
DELIVER
TRACK
DRIVE
TOOLS & ENVIRONMENT
OPERATIONAL EFFICIENCY
KPIs
![Page 24: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/24.jpg)
DESIGNCREATE
ANALYZEAUTOMATE
![Page 25: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/25.jpg)
ROOT ONE
![Page 26: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/26.jpg)
From ideation to building.From release to the future.
CODE FOR GROWTH
![Page 27: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/27.jpg)
Sources and additional reading
• Eficode materials “Tekoälyn vaikutukset ohjelmistotuotantoon -aamiaisseminaari 7.12. Helsingissä” Eficode materials “Devops ja mittaamisen magiaa -aamiaisseminaari Helsingissä 1.11.”
• DevOps and the Cost of Downtime: Fortune 1000, IDC• The Phoenix Project, Gene Kim, George Spafford, and Kevin Behr• Data-Driven DevOps: Use Metrics to Help Guide Your Journey, 2014 Gartner, Inc. Cameron Haight
and Tapati Bandopadhyay• Metrics that Matter - IntelliTect
![Page 28: Measurement magic in world of DevOps](https://reader031.vdocuments.us/reader031/viewer/2022030113/5899e6821a28ab96418b55a5/html5/thumbnails/28.jpg)
Come jam with us.
THANK YOU
Kai Jokiniemi
https://fi.linkedin.com/in/kaijokiniemi