devops culture in life science - usenix · pdf filedevops culture in life science ... intro...
TRANSCRIPT
December4–9,2016|Boston,MAwww.usenix.org/lisa16#lisa16
Peter Lega & Jason Victor, Merck
DevOps Culture in Life ScienceImplementing DevOps in a Regulated Traditionally Waterfall Environment
Introductions and About Us
Who we are
Merck & Co., IncHealthcareCompany
125Yearoldhealthcarecompany,intheFortune100,operaKngin140+countries,partofahighly-
regulatedindustry
Applied TechnologyInnovaKonGroup
BringingnewtechnologiestospeedupIT,creaKngnewproductsandmarkets,enablingplaTorm-basedtechnicalecosystems.
Peter LegaDirector,Architecture
AppliedTechnology,formerWeb/ContentManagementleadat
Merck.12yearsinHealthScience.AncientUnixKernelHacker,SiliconValley1.0(c|net),Middleware
geekonWallSt,Europeancommission.AutomaKondweeb.
Jason VictorAssoc.Director,DevOps
ArchitectatMerck,DevOpsLead,15yrsinHealthScience,17yrsinIT,6sigmagreenbelt,ITILPracKKoner,SoawareDeveloper,SupportLead,MastersfromDrexelUniversity,
MoravianCollegeMentor
H3
What we’ll cover todayIntro
There is hopeIt is possible to implement DevOps at a regulated company.
There is opportunityDevOps presents an unprecedented opportunity to accelerate the science and practice of healthcare.
There are still challengesHighly-regulated companies present unique challenges when introducing a technology culture like DevOps.
Our AppoachOur multi-year journey to augment our traditional, waterfall methodology with DevOps/Agile culture and methodology
Tool ChainYou still need technology to support DevOps. We’ll show you what we’re working on.
Cultural ShiftsHow we went from "that will never work" to "that's the new way to work."
Highly Regulated IndustriesDefinition: “a type of business that is controlled by government rules” [2]
Regulations keep consumers/patients/populations safe.
[2] Cambridge English Dictionary
Why Now?
Exploding Sources of Data & Methods
• Longitudinal / IoT • Genomic • Historical • Personalized Medicine • Data-driven invention • Open Data
Talent & Culture• Agile career mindset • Cross-functional Organizations • CrowdSourcing • DEVOPS
The Growing Arsenal of Technology
• Big Data tooling and infrastructure
• Mainstream Platform-driven ecosystems & economies
• Collaborative-based tooling • Quantum • Open Source
It’s the Perfect Storm
“[Y]ounger baby boomers held an average of 11.7 jobs from ages 18 to 48.” [1]
[1] Bureau of Labor Statistics
Impact
Reducing cycle time
Discovering things faster
Health - Improving lives
Year
s
0
3.5
7
10.5
14
DiscoveryPre-clinicalClinicalPhase IVLaunch
Cycle Time [3]
[3] J. A. DiMasi “Metrics on Technical Risks, Clinical Development Times, and Approval Times for Cancer Drugs”
Our 4 Key StrategiesHow?
Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup
w/KeyDecision-MakersCo-CreateanITstandardDevOps
plaTormIterate,improve,&PublishKPIs Over-communicate
Over-communicateOver-communicate
Foster a CommunityKey executive sponsors in word, wallet and deed.
Delivery-proven SW experts from both traditional and emerging sides.
(regulatory waterfall and agile/DevOps/tech)
The authoritative approvers (quality, compliance)
An effective training and communications group
Key senior SMEs/leaders willing to facilitate cross-organizationally
A set of first-follower business partners.
Software Development Extremes
VS
Traditional Regulated MindsetRisk Averse
Deliver complete solution Specialization and hand-offs
Get it right / lock it down Focused on Quality of Output
Innovation Mindset (Agile)Fail Fast
Minimum Viable Product (MVP) Cross-disciplinary teams Continuous Improvement
Focused on Quality of Output
Agile
Bridging Understanding With “Why”
Why
Traditional Regulated MindsetRisk Averse
Deliver complete solution Specialization and hand-offs
Get it right / lock it down Focused on Quality of Output
Innovation Mindset (Agile)Fail Fast
Minimum Viable Product (MVP) Cross-disciplinary teams Continuous Improvement
Focused on Quality of Output
Decrease FailureDeliver Right ProductIncrease Efficiency
Increase Quality
Agile
From Conflict to SynergyTraditional DevOps
EstablishedSupportandOperaKonsatScale
GlobalCoverage
GlobalCommunicaKonsServices
MatureRegulatoryServices
DeepRegulatoryKnowledge
ViralCollaboraKonEcosystems
IncreasedTransparency
AcceleratedSoawareDelivery
CultureofInnovaKon&InvenKon
IndustryEdgeSensing
From Conflict to Synergy
EstablishedSupportandOperaKonsatScale
GlobalCoverage
GlobalCommunicaKonsServices
MatureRegulatoryServices
DeepRegulatoryKnowledge
ViralCollaboraKonEcosystems
IncreasedTransparency
AcceleratedSoawareDelivery
CultureofInnovaKon&InvenKon
IndustryEdgeSensing
Traditional DevOps AND
Our 4 Key Strategies
Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup
w/KeyDecision-MakersCo-CreateanITstandardDevOps
plaTormIterate,improve,&PublishKPIs Over-communicate
Over-communicateOver-communicate
Our DevOps Toolchain
Ideas
Collab.Wiki(Confluence)
Tracking(JIRA)
SCM (Bitbucket)
ContinuousIntegration(CI)Orchestration(Jenkins)
ContainerMgmt
Rel.Mgmt
TestMgmtAutoTesting
(RobotFramework)
Search Guardrails
OfficeAPITest Mgmt CMDB
DevOps Program
DefinitiveMediaLibrary
Monitoringtools
TestDataMgmt
InfoSecScans
DeploymentTarget(IaaSandDBaaS)(ContainerorServer)(On-PremorCloud)
IT Automation
Service Management
Service Mgmt
Release Mgmt
IT Automation
CDOrchestration
Our 4 Key Strategies
Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup
w/KeyDecision-MakersCo-CreateanITstandardDevOps
plaTormIterate,improve,&PublishKPIs Over-communicate
Over-communicateOver-communicate
Iterate, Improve & Gather InsightsProcess that grows over time
Git RepoCollaboration
SuiteAutomate
Partly Qualified Fully Qualified
Start with the basic code check in
Wiki, Issue Tracking
CI / CD Suite
Regulated processes can use pieces of the DevOps Stack
Regulated processes can fully utilize the DevOps Stack
Acceleration of Dev Tools Usage
0
150
300
450
600
Q1 Q2 Q3 Q4 Q1 Q2 Q3
JIRA Bitbucket Confluence
Active Projects
2015 2016
Confluence 3,300
Bitbucket 500
JIRA 1,300
Active User Count
Acceleration of APIs
0
0.2
0.4
0.6
0.8
Jan Feb Mar Apr May Jun Jul Aug Sep
CENTSAPI Costs per user
0
200
400
600
800
J F M A M J J A S O N D J F M A M J J A S
Requests/Month (thousands)GBs/Month
API Usage
2015 2016 2016
Rinse & RepeatIterate, Improve & Gather Insights
Inform the portfolio
Cross project insight & improvement
Sales App
Working MVP in 2 months
Clinical Trials App
6 months instead of 18
Our 4 Key Strategies
Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup
w/KeyDecision-MakersCo-CreateanITstandardDevOps
plaTormIterate,improve,&PublishKPIs Over-communicate
Over-communicateOver-communicate
Over Communicate
Telling stories
Sharing success
Showing data
Plain English, please
Our 4 Key StrategiesIn the Spirit of Over Communicating…
Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup
w/KeyDecision-MakersCo-CreateanITstandardDevOps
plaTormIterate,improve,&PublishKPIs Over-communicate
Over-communicateOver-communicate
Impact
Reducing cycle time
Discovering things faster
Health - Improving lives
Cycle Time
Year
s
0
3.5
7
10.5
14
DiscoveryPre-clinicalClinicalPhase IVLaunch
Impact
Reducing cycle time
Discovering things faster
Health - Improving lives
Remember - It’s Personal