2016 metrics-as-culture
TRANSCRIPT
![Page 1: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/1.jpg)
@nicolefv
HOWMETRICSSHAPEYOURCULTURE
NICOLEFORSGREN,PHD
@NICOLEFV
DIRECTOR,ORGANIZATIONALPERFORMANCEANDANALYTICS,CHEF
CO-FOUNDER,DEVOPSRESEARCHANDASSESSMENT
![Page 2: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/2.jpg)
@nicolefv
WEDON’TALWAYSTHINKOFITTHISWAY,BUT…
measurementis culture
![Page 3: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/3.jpg)
@nicolefv
![Page 4: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/4.jpg)
@nicolefv
"AsgoodasAmazonwas,itdidnotyethaveaculturethatfullyembracedmeasurementanddebate. Ithinkbuildingthiscultureisthekeytoinnovation. Creativitymustflowfromeverywhere.WhetheryouareasummerinternortheCTO,anygoodideamustbeabletoseekanobjectivetest,preferablyatestthatexposestheideatorealcustomers.Everyonemustbeabletoexperiment,learn,anditerate.Position,obedience,andtraditionshouldholdnopower.Forinnovationtoflourish,measurementmustrule.”- GregLindenhttp://glinden.blogspot.com/2006/04/early-amazon-shopping-cart.html
![Page 5: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/5.jpg)
@nicolefv
YOUCAN’TIMPROVEWHATYOUDON’TMEASURE
@nicolefv
![Page 6: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/6.jpg)
@nicolefv
Evaluatingwell-designedandexecutedexperimentsthatweredesignedtoimproveakeymetric,onlyabout1/3weresuccessfulatimprovingthekeymetric!
Online Experimentation atMicrosoft, Kohavi etal.http://stanford.io/130uW6X
![Page 7: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/7.jpg)
@nicolefv
ALWAYSMEASURETHINGSTHATMATTER
![Page 8: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/8.jpg)
@nicolefv@nicolefv
THATWHICHISMEASUREDGETSMANAGED
Inbusiness, youarewhatyoumeasure
![Page 9: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/9.jpg)
@nicolefv
IFYOUCAPTUREONLYONEMETRIC,YOUKNOWWHATWILLBEGAMED
@nicolefv
![Page 10: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/10.jpg)
@nicolefv@nicolefv
Sometimes, wejustmeasure ALLTHETHINGS.ButSTOPandaskyourself:
• Whatdoesthistellme?
• HowcanIusethistomakeadecision?
• Howdoesthisrelatetoanoutcome?
• Does itstillmakesense tomeasureandtrackthismetric?
• Whataretheunintended consequences ofimplementing this?
NOTEVERYTHINGTHATCANBECOUNTED…
COUNTS
![Page 11: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/11.jpg)
@nicolefv
METRICSINFORMOURINCENTIVES…ANDSHAPEBEHAVIOR
![Page 12: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/12.jpg)
@nicolefv
METRICSINFORMOURINCENTIVES…ANDSHAPEBEHAVIOR
Metric=delivercodeonschedule
Behavior=sprinttodelivercodeat5pmonFriday
Unintended consequence =opsteamspends theweekendputtingoutfires
![Page 13: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/13.jpg)
@nicolefv
![Page 14: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/14.jpg)
@nicolefv
JUSTBECAUSESOMETHINGISHARDTOMEASUREDOESN’TMEANITISN’TWORTHMEASURING
![Page 15: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/15.jpg)
@nicolefv
WESTRUM ORGANIZATIONALCULTUREPATHOLOGICALPower-oriented
BUREACRATICRule-oriented
GENERATIVEPerformance-oriented
Lowcooperation Modest cooperation Highcooperation
Messengers shot Messengers neglected Messengers trained
Responsibilities shirked Narrowresponsibilities Risks areshared
Bridging discouraged Bridging tolerated Bridging encouraged
Failure leads toscapegoating Failure leads tojustice Failure leads toinquiry
Novelty crushed Novelty leads toproblems Novelty implemented
Westrum,R.(2004).Atypologyoforganisational cultures. Qualityandsafetyinhealthcare, 13(suppl 2),ii22-ii27.
![Page 16: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/16.jpg)
@nicolefv
HOWTOMEASUREWESTRUMORGANIZATIONALCULTUREINASTATISTICALLY VALID&RELIABLEWAYRatehowstronglyyouagree(7)ordisagree (1)tothefollowingstatements:
• Onmyteam, information isactivelysought.
• Onmyteam,failuresarelearningopportunities, andmessengers ofthemarenotpunished.
• Onmyteam,responsibilities areshared.
• Onmyteam,cross-functional collaboration isencouragedandrewarded.
• Onmyteam,failurecausesenquiry.
• Onmyteam,newideasarewelcomed.
Forsgren,N.,J.Humble(2016).“TheRoleofContinuousDeliveryinITandOrganizationalPerformance.”IntheProceedingsoftheWesternDecisionSciencesInstitute(WDSI)2016,LasVegas, NV.
![Page 17: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/17.jpg)
@nicolefv
WHATCANIDO?
• ReadandshareDataDriven,by@dpatil and@hmason• Askothersaboutmetrics:
• Isithappening?Where?
• Isitimportant?
• Thinkaboutyourownmetrics:• Startwithoutcomes:what’simportant?
• Thenthinkaboutwhatinfluences youroutcomes
• Defineandcommunicate
![Page 18: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/18.jpg)
@nicolefv
METRICSHELPUSCOMMUNICATE
KEY:• Givethemmeaningfulnames• Definethemwell• Communicatethemoftenandacrossboundaries
![Page 19: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/19.jpg)
@nicolefv
WE’VETALKEDABOUT:
MEASUREMENT ISCULTURE
• Youcan’timprovewhatyoudon’tmeasure
• Alwaysmeasurethingsthatmatter
• Thatwhichismeasured getsmanaged
• Ifyoucaptureonlyonemetric,youknowexactlywhatwillbegamed
• Metrics informourincentives… andshapebehavior
• Noteverything thatcanbecounted...Counts
• Justbecause something ishardtomeasure doesn’tmean itisn’tworthmeasuring
![Page 20: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/20.jpg)
@nicolefv
IFMEASUREMENTISCULTURE&YOUAREN’TMEASURINGYOURWORK...
howisitaffectingyourculture?
![Page 21: 2016 metrics-as-culture](https://reader031.vdocuments.us/reader031/viewer/2022030216/58889a7d1a28ab264b8b4bcf/html5/thumbnails/21.jpg)
@nicolefv
THANKYOUNICOLEFV.COM