continuous delivery - pnsqc · continuous delivery ... intuit, inc. 2 2 great innovative place to...

18
Continuous Delivery Bridging Quality Between Development and Customers John Ruberto, Director of Quality Engineering, Intuit, Inc.

Upload: trinhcong

Post on 01-May-2018

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

Continuous Delivery Bridging Quality Between Development and Customers

John Ruberto, Director of Quality Engineering, Intuit, Inc.

Page 2: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

2 2 2

Great Innovative Place to Work

2

2011

2012

#8 Intuit Inc.

2013

Our 13th

Year !!

Page 3: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

3 3 3

Intuit’s mission

To improve our customers’ financial lives so profoundly…

they can’t imagine going back to the old way

CONSUMERS SMALL

BUSINESSES

ACCOUNTING

PROFESSIONALS

Page 4: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

4 4 4

I thought we were agile enough

• 3 Week release cycles

• Business team wanted to move faster

– Faster innovations

– Lots of change – complete redesign

– Complex release environment (many products)

• We moved to Continuous Delivery

– Refreshed technology, team, and site

– When a story is complete – it gets deployed.

Page 5: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

5 5

SLDC

Define

Code & Unit Test

Integration Test

System Test

Deploy

Page 6: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

6 6

Continuous Integration

Define

Code & Unit Test

Integration Test

System Test

Deploy ✔

Page 7: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

7 7

Continuous Delivery

Define

Code & Unit Test

Integration Test

System Test

Deploy

✔ ✔

Page 8: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

8 8

Continuous Deployment

Define

Code & Unit Test

Integration Test

System Test

Deploy ✔

✔ ✔

Page 9: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

9 9

3-Week Release Cycle

Define Code & UT Sys

Test

Define Code & UT Sys

Test

Iteration

N

Iteration

N+1

Deploy Deploy 3 Weeks

Page 10: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

10 10 10

• Increase Velocity of Innovation

• Planning Flexibility

• Avoiding Technical Debt

• Teamwork

Benefits of Continuous Delivery

Page 11: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

11 11 11

• Requires a low cost of deployment

• You control deployment

• Regulatory environment might not be compatible

• Difficult to retrofit into existing applications

• Applications that operate extensively on data

Use Caution

Page 12: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

12 12 12

• Web-based support for 4 million small business

users and accountants

• Design refresh across our product eco-system

• Ease is vital

• Old site:

– Lots of tech debt (50% of effort in each

release)

– 3-week release cycle - Scrum

QuickBooks Support site

Page 13: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

13 13 13

The Case for Change

• Quicker delivery = fewer customer frustrations

• Technology refresh was required to make this

happen

– Good for long term

– Good for engineering team

– Good for business

Page 14: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

14 14 14

• Collaboration

• Test First (TDD)

• Everyone Tests

• Accountability with

each build

• Deployment

automation built in

People Investments

OLD NEW

• Structured Hand-off

• Build then test

• QA Tests

• Tests Reveal

Problems

• Manual Deployments

Page 15: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

15 15 15

• Ruby / Ruby-on-Rails

• Rspec: BDD Framework

• Jenkins

• Chef

• Static Analysis/style checker

• Amazon AWS

• Selenium Webdriver

Technology Investments

Page 16: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

16 16

Deployment Pipeline

Developer

Machine Integration

Pre-

Production Production P

a

s

s

P

a

s

s

P

a

s

s

A

p

p

r

o

v

e

• Code Review

• Unit Test

• Accretive

Test

Coverage

Deployment

Pipeline

Practices • Static Analysis

• Automated UAT

• Performance

• Deployment

Validation

• Business

Decision to

Release

Page 17: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

17 17 17

• Make sure of business need & business is

committed

• Is your system compatible with CD

• Does your team have the Agile mindset?

• Your technology should support CI & automated

deployment

• Start small and build incrementally

Tips

Page 18: Continuous Delivery - PNSQC · Continuous Delivery ... Intuit, Inc. 2 2 Great Innovative Place to Work 2 2011 20122013 #8 Intuit Inc. ... Q&A . Title: Customer-Driven Quality

18 18 18

Contact me:

[email protected]

– Blog.ruberto.com

– @JohnRuberto

– Linkedin.com/in/ruberto

Q&A