digital information manufacturing - scale€¦ · spc, value stream mapping, lean and devops lee...

23
Digital Information Manufacturing SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs

Upload: others

Post on 11-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Digital InformationManufacturing

SPC, Value Stream Mapping, Lean and DevOpsLee Thompson - CTO MorphLabs

Page 2: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

About Lee

10 years of distributed control systemsdesign, implementation, and integration

13 years of online financial services atE*TRADE (dev, arch, and ops)

Advisor to DTO Solutions, Exist,MaestroDev

Blogger at http://dev2ops.org

CTO at MorphLabs

••

Page 3: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Fully automated provisioning paper: 10/09

OpsCamp Austin: 01/10

O’Reilly Velocity Online: 03/10

Google group “devops-toolchain”: 03/10

OpsCamp SF: 05/10

O’Reilly Velocity presenter2010 and 2011

DevOps Days, 06/11, 12/11

••••••

DevOps contributor...

Page 4: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

About my sponsor!

Page 5: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps intro

@damonedwards

Wal

l of C

onfu

sion

Development Operations

I want stability!

I want change!

Page 6: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps intro

@damonedwards

Wal

l of C

onfu

sion

Development Operations

Page 7: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps intro

@damonedwards

Wal

l of C

onfu

sion

Dev Tools !! Ops Tools

Page 8: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps intro

@damonedwards

ah ha! ka ching!

Biz Dev Ops

Business Process

Agile Developmentfixes this

DevOpsfixes this

Page 9: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Development Drivers

Lack of visibility into production tools andconfiguration to reliably effect change

Schedule slippage due to deploymentproblems which can’t be produced in devenvironment

Lack of understanding in operations ofapplication nuances and ideal utilization

Release process awkward and meetingintensive

•wikipedia

Page 10: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Operations Drivers

80% of all production outages are relatedto change (“Visible Ops”)

Developers can’t support scale, uptime,security initiatives

Developers apply configuration changesmanually without deployment automation inmind

Over allocating Ops staff to app releaseprojects

Page 11: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Lots of time on Deploy!

Data Source: Deepak Patil, Microsoft Global  Foundation Services via James Hamilton (Amazon Web Services)http://mvdirona.com/jrh/TalksAndPapers/JamesHamilton_POA20090226.pdf

DeploymentManagement

Total31%

ProblemEngineering

Total10%

Overhead Total11%

Requests Total6%

SoftwareDevelopment

Total7%

Site ManagementTotal7%

ArchitecturalEngineering Total

8%

IncidentManagement

(deployment related)16%

IncidentManagement

(other)4%

~47% of total time

Page 12: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Control Systems

The Simpsons is Copyright Foxused for education purposes

Page 13: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

App Control “points”

Webhits/sec, latency

Firewall MBits/Sec

Auth Success/Fail per Second, latency

Transactions Second, latency

Service Queue Depths

App errors/sec by type

Users

.....

••••••••

Page 14: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Digital Info Manufacturing

Almost everyone has monitoring in theirtechnical operations

Almost no one has control

If you business is data, isn’t yourapplication manfacturing that data?

••

Page 15: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Control Toolchain

Measurement Instrumentation

System

Charting, History, SPC

Eventing, Alarm Mgmt

Control

Runbook Automation

Page 16: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

SPC Control Charting

wikipedia

Page 17: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Value Stream Mapping

Page 18: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps intro next gen!

ah ha! ka ching!

Biz Dev Ops

Business Process

Agile Developmentfixes this

DevOpsfixes this

Value Stream Map this!

Page 19: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Getting Buy-in

Put the problem in Business terms

“Lean Startup” best reference I’ve found

Minimum Viable System

Reduce the Batch Size

Continuous Integration

Continuous Deployment

Innovation Accounting

Fail quick and Pivot!

••

•••••

Page 20: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps part of Lean

Page 21: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

DevOps part of Lean

ah ha! ka ching!

Biz Dev Ops

Business Process

Agile Developmentfixes this

DevOpsfixes this

Page 22: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Build the future

Current State Future State

Page 23: Digital Information Manufacturing - SCALE€¦ · SPC, Value Stream Mapping, Lean and DevOps Lee Thompson - CTO MorphLabs. About Lee 10 years of distributed control systems design,

Get it under Control