continuous deployment at etsy - sxsw 2012 lean startup track

50
Continuous Deployment at Etsy Chad Dickerson, CEO [email protected] / @chaddickerson March 10, 2012 SXSW

Upload: chad-dickerson

Post on 15-Apr-2017

17.000 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Continuous Deployment at Etsy

Chad Dickerson, [email protected] / @chaddickerson

March 10, 2012SXSW

Page 2: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track
Page 3: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

1.4B page views per month$525MM sales on Etsy in 201139MM unique visitors / month800K shops / 150 countries100+ engineers

By the numbers

Page 4: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

“The Etsy Way”http://etsy.me/etsyway

Page 5: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Our simple definition of continuous deployment:Small, frequent changes

to production.

Page 6: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Continuous deployment transformed Etsy

Page 7: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

6/05 9/08 12/09 9/10

Timeline

Etsy launches I joined

First 1-button deploy; 7

deploys in ’09

StatsD(graphs!)

12/10 12/11

3,029 deploys

in ‘10

10,068deploys

in ‘11

12/12

10x growth

Page 8: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

September 2008

Page 9: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

“There are issues to address now and there will most certainly be bumps on the technology side as Etsy grows, but I want all of you Etsians to know that it is an honor and a privilege to be serving the Etsy community as your CTO. If you can give me some time and understanding here in my early days at Etsy, I hope to make you proud.”

- An Honest Beginning for Etsy’s New CTO (company blog)

http://www.etsy.com/blog/en/2008/tech-update-an-honest-beginning-for-etsys-new-cto/

Page 10: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Problems!

Page 11: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

What was missing at Etsy at the time

Page 12: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

• Culture of transparency!

• Monitoring

• Metrics / Graphing

• Automated testing

• Error log analysis

Page 13: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

The present

Page 14: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

6/05 9/08 12/09 9/10

Timeline

Etsy launches I joined

First 1-button deploy; 7

deploys in ’09

StatsD(graphs!)

12/10 12/11

3,029 deploys

in ‘10

10,068deploys

in ‘11

12/12

10x growth

Page 15: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Confidence as a Service

Page 16: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Fred

Board members deploy!

Page 17: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Dogs deploy!

Page 18: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

How we got there

Page 19: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Most important issue?

Culture.

Page 20: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Peopleware:“the major problems of

our work are not so much technological as

sociological in nature”

Page 21: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

“Any organization that designs a system (defined broadly) will produce a design whose structure is a copy of the organization's communication structure.”

Conway’s Law:

- Melvin Conway, 1968

Page 22: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Fix people and team issues first.

Page 23: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Communication

Page 24: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Insist on transparency

Page 26: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Blameless post-mortems

http://www.slideshare.net/jallspaw/advanced-postmortem-fu-and-human-error-101-velocity-2011

Page 27: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Key tools at Etsy

Page 28: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Deployinator:One button deploy

https://github.com/etsy/deployinator

Page 29: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track
Page 30: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track
Page 31: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track
Page 32: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

StatsD:Graphs, democratized

https://github.com/etsy/statsd

Page 33: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Code talks.

Make graphs!

Page 34: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Yes! No.

Page 35: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Dashboard Driven Development**

**60,000 graphs, ~30 of the most important ones on deploy dashboard

Page 36: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Errors*

*Vertical lines are deploys!

Page 37: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Key business metrics*

*Vertical lines are deploys!

Page 38: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Automated Testing

http://codeascraft.etsy.com/2011/04/20/divide-and-concur/

Page 39: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

What continuous deployment gives Etsy

Page 40: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Agility: Always Be Shipping

Page 41: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

MTTD / MTTR

Page 42: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Stability & predictability

Page 43: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Encourages experimentation

Page 44: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Developer happiness

Page 45: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

DevOps

Page 46: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

Scales trust and risk

Page 47: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

“Not being in a state to deploy is a matter of liability. It's like having the only fire exit blocked. You ignore it at everyone's peril.”

— Lacy Rhoades, Etsy Engineer

Page 48: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

“an ecosystem where the lazy, excitable and impatient really shine”

— Andrew Morrison, Etsy Engineer“The Product Hacking Ecosystem”

http://codeascraft.etsy.com/2012/01/04/the-product-hacking-ecosystem/

Page 49: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track

ResourcesCode as Craft bloghttp://codeascraft.etsy.com/

Slides (including these)http://www.slideshare.net/etsy

Github http://github.com/etsy/

Join in the fun http://www.etsy.com/careers/

Page 50: Continuous Deployment at Etsy - SXSW 2012 Lean Startup Track