devops culture in life science - usenix · pdf filedevops culture in life science ... intro...

25
December 4–9, 2016 | Boston, MA www.usenix.org/lisa16 #lisa16 Peter Lega & Jason Victor, Merck DevOps Culture in Life Science Implementing DevOps in a Regulated Traditionally Waterfall Environment

Upload: tranminh

Post on 28-Mar-2018

217 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

December4–9,2016|Boston,MAwww.usenix.org/lisa16#lisa16

Peter Lega & Jason Victor, Merck

DevOps Culture in Life ScienceImplementing DevOps in a Regulated Traditionally Waterfall Environment

Page 2: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Introductions and About Us

Who we are

Merck & Co., IncHealthcareCompany

125Yearoldhealthcarecompany,intheFortune100,operaKngin140+countries,partofahighly-

regulatedindustry

Applied TechnologyInnovaKonGroup

BringingnewtechnologiestospeedupIT,creaKngnewproductsandmarkets,enablingplaTorm-basedtechnicalecosystems.

Peter LegaDirector,Architecture

AppliedTechnology,formerWeb/ContentManagementleadat

Merck.12yearsinHealthScience.AncientUnixKernelHacker,SiliconValley1.0(c|net),Middleware

geekonWallSt,Europeancommission.AutomaKondweeb.

Jason VictorAssoc.Director,DevOps

ArchitectatMerck,DevOpsLead,15yrsinHealthScience,17yrsinIT,6sigmagreenbelt,ITILPracKKoner,SoawareDeveloper,SupportLead,MastersfromDrexelUniversity,

MoravianCollegeMentor

H3

Page 3: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

What we’ll cover todayIntro

There is hopeIt is possible to implement DevOps at a regulated company.

There is opportunityDevOps presents an unprecedented opportunity to accelerate the science and practice of healthcare.

There are still challengesHighly-regulated companies present unique challenges when introducing a technology culture like DevOps.

Our AppoachOur multi-year journey to augment our traditional, waterfall methodology with DevOps/Agile culture and methodology

Tool ChainYou still need technology to support DevOps. We’ll show you what we’re working on.

Cultural ShiftsHow we went from "that will never work" to "that's the new way to work."

Page 4: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Highly Regulated IndustriesDefinition: “a type of business that is controlled by government rules” [2]

Regulations keep consumers/patients/populations safe.

[2] Cambridge English Dictionary

Page 5: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Why Now?

Exploding Sources of Data & Methods

• Longitudinal / IoT • Genomic • Historical • Personalized Medicine • Data-driven invention • Open Data

Talent & Culture• Agile career mindset • Cross-functional Organizations • CrowdSourcing • DEVOPS

The Growing Arsenal of Technology

• Big Data tooling and infrastructure

• Mainstream Platform-driven ecosystems & economies

• Collaborative-based tooling • Quantum • Open Source

It’s the Perfect Storm

“[Y]ounger baby boomers held an average of 11.7 jobs from ages 18 to 48.” [1]

[1] Bureau of Labor Statistics

Page 6: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Impact

Reducing cycle time

Discovering things faster

Health - Improving lives

Year

s

0

3.5

7

10.5

14

DiscoveryPre-clinicalClinicalPhase IVLaunch

Cycle Time [3]

[3] J. A. DiMasi “Metrics on Technical Risks, Clinical Development Times, and Approval Times for Cancer Drugs”

Page 7: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Our 4 Key StrategiesHow?

Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup

w/KeyDecision-MakersCo-CreateanITstandardDevOps

plaTormIterate,improve,&PublishKPIs Over-communicate

Over-communicateOver-communicate

Page 8: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Foster a CommunityKey executive sponsors in word, wallet and deed.

Delivery-proven SW experts from both traditional and emerging sides.

(regulatory waterfall and agile/DevOps/tech)

The authoritative approvers (quality, compliance)

An effective training and communications group

Key senior SMEs/leaders willing to facilitate cross-organizationally

A set of first-follower business partners.

Page 9: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Software Development Extremes

VS

Traditional Regulated MindsetRisk Averse

Deliver complete solution Specialization and hand-offs

Get it right / lock it down Focused on Quality of Output

Innovation Mindset (Agile)Fail Fast

Minimum Viable Product (MVP) Cross-disciplinary teams Continuous Improvement

Focused on Quality of Output

Agile

Page 10: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Bridging Understanding With “Why”

Why

Traditional Regulated MindsetRisk Averse

Deliver complete solution Specialization and hand-offs

Get it right / lock it down Focused on Quality of Output

Innovation Mindset (Agile)Fail Fast

Minimum Viable Product (MVP) Cross-disciplinary teams Continuous Improvement

Focused on Quality of Output

Decrease FailureDeliver Right ProductIncrease Efficiency

Increase Quality

Agile

Page 11: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

From Conflict to SynergyTraditional DevOps

EstablishedSupportandOperaKonsatScale

GlobalCoverage

GlobalCommunicaKonsServices

MatureRegulatoryServices

DeepRegulatoryKnowledge

ViralCollaboraKonEcosystems

IncreasedTransparency

AcceleratedSoawareDelivery

CultureofInnovaKon&InvenKon

IndustryEdgeSensing

Page 12: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

From Conflict to Synergy

EstablishedSupportandOperaKonsatScale

GlobalCoverage

GlobalCommunicaKonsServices

MatureRegulatoryServices

DeepRegulatoryKnowledge

ViralCollaboraKonEcosystems

IncreasedTransparency

AcceleratedSoawareDelivery

CultureofInnovaKon&InvenKon

IndustryEdgeSensing

Traditional DevOps AND

Page 13: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Our 4 Key Strategies

Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup

w/KeyDecision-MakersCo-CreateanITstandardDevOps

plaTormIterate,improve,&PublishKPIs Over-communicate

Over-communicateOver-communicate

Page 14: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Our DevOps Toolchain

Ideas

Collab.Wiki(Confluence)

Tracking(JIRA)

SCM (Bitbucket)

ContinuousIntegration(CI)Orchestration(Jenkins)

ContainerMgmt

Rel.Mgmt

TestMgmtAutoTesting

(RobotFramework)

Search Guardrails

OfficeAPITest Mgmt CMDB

DevOps Program

DefinitiveMediaLibrary

Monitoringtools

TestDataMgmt

InfoSecScans

DeploymentTarget(IaaSandDBaaS)(ContainerorServer)(On-PremorCloud)

IT Automation

Service Management

Service Mgmt

Release Mgmt

IT Automation

CDOrchestration

Page 15: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Our 4 Key Strategies

Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup

w/KeyDecision-MakersCo-CreateanITstandardDevOps

plaTormIterate,improve,&PublishKPIs Over-communicate

Over-communicateOver-communicate

Page 16: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Iterate, Improve & Gather InsightsProcess that grows over time

Git RepoCollaboration

SuiteAutomate

Partly Qualified Fully Qualified

Start with the basic code check in

Wiki, Issue Tracking

CI / CD Suite

Regulated processes can use pieces of the DevOps Stack

Regulated processes can fully utilize the DevOps Stack

Page 17: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Acceleration of Dev Tools Usage

0

150

300

450

600

Q1 Q2 Q3 Q4 Q1 Q2 Q3

JIRA Bitbucket Confluence

Active Projects

2015 2016

Confluence 3,300

Bitbucket 500

JIRA 1,300

Active User Count

Page 18: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Acceleration of APIs

0

0.2

0.4

0.6

0.8

Jan Feb Mar Apr May Jun Jul Aug Sep

CENTSAPI Costs per user

0

200

400

600

800

J F M A M J J A S O N D J F M A M J J A S

Requests/Month (thousands)GBs/Month

API Usage

2015 2016 2016

Page 19: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Rinse & RepeatIterate, Improve & Gather Insights

Inform the portfolio

Cross project insight & improvement

Sales App

Working MVP in 2 months

Clinical Trials App

6 months instead of 18

Page 20: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Our 4 Key Strategies

Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup

w/KeyDecision-MakersCo-CreateanITstandardDevOps

plaTormIterate,improve,&PublishKPIs Over-communicate

Over-communicateOver-communicate

Page 21: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Over Communicate

Telling stories

Sharing success

Showing data

Plain English, please

Page 22: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Our 4 Key StrategiesIn the Spirit of Over Communicating…

Community DevOps Platform Improve Over-communicateFosteracommunity-Bobomup

w/KeyDecision-MakersCo-CreateanITstandardDevOps

plaTormIterate,improve,&PublishKPIs Over-communicate

Over-communicateOver-communicate

Page 23: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Impact

Reducing cycle time

Discovering things faster

Health - Improving lives

Cycle Time

Year

s

0

3.5

7

10.5

14

DiscoveryPre-clinicalClinicalPhase IVLaunch

Page 24: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools

Impact

Reducing cycle time

Discovering things faster

Health - Improving lives

Remember - It’s Personal

Page 25: DevOps Culture in Life Science - USENIX · PDF fileDevOps Culture in Life Science ... Intro There is hope ... Test Mgmt CMDB DevOps Program Definitive Media Library Monitoring tools