devops and cloud native
TRANSCRIPT
![Page 1: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/1.jpg)
![Page 2: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/2.jpg)
![Page 3: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/3.jpg)
[email protected]• In 1999, built a 20M page view per month Web site
• On two (2) HP servers (active-passive, manual failover)
• Dual Pentium 3 CPUs at 500+ MHz, 256MB RAM, 200GB HD
• ASP and C++ on Microsoft IIS
![Page 4: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/4.jpg)
![Page 5: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/5.jpg)
![Page 6: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/6.jpg)
I.T. IS FACING GROWING DEMAND AND COMPLEXITY
![Page 7: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/7.jpg)
![Page 8: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/8.jpg)
2009
790 EB
2010
1.2 ZB
2020
40 ZB
2015
7.9 ZB
http://www.csc.com
Global Data
![Page 9: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/9.jpg)
![Page 10: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/10.jpg)
“EXPONENTIAL GROWTH WILL CONTINUE INDEFINITELY: YOU WILL NEED TO HANDLE TWICE AS MUCH CRAP TODAY AS YOU DID
18 MONTHS AGO.”
“EXPONENTIAL GROWTH WILL CONTINUE INDEFINITELY: YOU WILL NEED TO HANDLE TWICE AS MUCH CRAP TODAY AS YOU DID
18 MONTHS AGO.”
![Page 11: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/11.jpg)
20 © 2014 CA. ALL RIGHTS RESERVED.
Technology opens the door to many more competitors
…and perhaps takes banks out of the equation
![Page 12: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/12.jpg)
WINNERS VS LOSERS
![Page 14: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/14.jpg)
![Page 15: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/15.jpg)
![Page 16: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/16.jpg)
![Page 17: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/17.jpg)
70 © 2014 CA. ALL RIGHTS RESERVED.
How long does it take you to deploy your application?
INCLUDING ROLE BASED ACCESS
INCLUDING MONITORING
INCLUDING CONNECTIVITY
![Page 18: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/18.jpg)
![Page 20: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/20.jpg)
DEVS VS. OPS
• “Move fast and break things.”
• Iterations: from 2 weeks down to continuous
• “It works on my machine!”
• Security? Privacy? Backups?
• “Don’t fix it if it ain’t broke.
• Procurement: from 2 weeks up to 4 months
• Dev ≠ Test ≠ Staging ≠ Production
• Security! Privacy! Backups!
![Page 21: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/21.jpg)
WHAT DEVOPS IS NOT
• Tool or Technology
• Methodology
• Role or a Team
• Silver bullet
![Page 22: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/22.jpg)
![Page 23: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/23.jpg)
![Page 24: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/24.jpg)
VIRTUALISATION
![Page 25: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/25.jpg)
CPU RAM HD NIC
Operating System
Applications
![Page 26: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/26.jpg)
CPU RAM HD NIC
Virtualisation
Operating System
Application
Operating System
Application
![Page 27: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/27.jpg)
Operating System
Application
Operating System
Application
Operating System
Application
Virtualisation Platform
Operating System
Application Application
![Page 28: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/28.jpg)
CLOUD CLOUD
![Page 30: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/30.jpg)
![Page 31: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/31.jpg)
INFRASTRUCTURE AS CODE
• Can be checked into source control
• Can be versioned
• Can be audited
• Can be automatically executed
![Page 32: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/32.jpg)
HOW WE USED TO DO SOURCE CONTROL:
“Don’t touch files A and B I’m not done with them yet.”
![Page 33: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/33.jpg)
GITPlus branching strategy (e.g. git flow)
![Page 34: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/34.jpg)
"ABOUT 15 - 50 ERRORS PER 1000 LINES OF DELIVERED CODE."
Steve McConnell, Code Complete
BUGS PER LINES OF CODE
![Page 36: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/36.jpg)
AUTOMATED TESTING
![Page 38: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/38.jpg)
![Page 39: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/39.jpg)
MICROSERVICES
![Page 40: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/40.jpg)
http://martinfowler.com/articles/microservices.html
![Page 43: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/43.jpg)
WE CAN REWRITE OUR SERVICES AT WILL - WHICH WE DO, RATHER THAN CONTINUE TO REFACTOR THEM OR TO ADD MORE AND MORE TECHNICAL DATA OVER TIME. WE JUST REWRITE THEM WHEN WE GET TO A SCALING INFLECTION POINT.
Kevin GoldsmithVP of Engineering at Spotify
MICROSERVICES
![Page 44: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/44.jpg)
![Page 45: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/45.jpg)
SHIPPING?
![Page 46: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/46.jpg)
![Page 47: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/47.jpg)
SHIPPING!
![Page 48: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/48.jpg)
WHAT DOCKER IS NOT
• Not just lightweight VMs
• Not another configuration management tool
• Not a silver bullet
![Page 58: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/58.jpg)
![Page 59: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/59.jpg)
![Page 60: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/60.jpg)
![Page 61: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/61.jpg)
![Page 62: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/62.jpg)
![Page 63: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/63.jpg)
APPLICATION WITH DEPENDENCIES
![Page 64: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/64.jpg)
http://www.theregister.co.uk/2015/11/06/containers_thrash_vms_in_the_power_consumption_stakes/
![Page 66: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/66.jpg)
“The biggest single benefit of Docker is the extent that it’s empowered the team to build services from scratch. We no longer have a complex set of provisioning scripts or AMIs—we just hand the production cluster an image, and it runs. There’s no more stateful instances, and we’re guaranteed to run the same exact code on both staging and prod.”
http://highscalability.com/blog/2015/10/19/segment-rebuilding-our-infrastructure-with-docker-ecs-and-te.html
DEVCON 2015 TECH RADAR
![Page 67: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/67.jpg)
![Page 68: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/68.jpg)
KUBERNETES• A platform for container management and
orchestration
• Started by Google (based on their internal Borg platform) and released Open Source
• Donated to the Linux Foundation in 2015
• 4000+ contributors and 40,000+ code commits (Dec 2016)
• Being adopted quickly by large Enterprises, Banks, Retail, etc (Walmart, SAP, Goldman Sachs, Box, etc)
• Sometimes referred to as GIFEE ("Google’s Infrastructure for Everyone Else")
![Page 69: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/69.jpg)
KUBERNETES• All the benefits of Docker, but at
enterprise or "Web scale"
• Turn-key support from major cloud providers (Google, Microsoft)
• Can run on-premise
• Bare metal
• OpenStack
• Kubernetes Federated Clusters!
• Hybrid cloud
• Multi-cloud
![Page 70: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/70.jpg)
CLOUD NATIVECLOUD NATIVE
![Page 71: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/71.jpg)
![Page 72: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/72.jpg)
![Page 73: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/73.jpg)
SHIPPING CADENCE DEFINES YOUR COMPANY
![Page 74: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/74.jpg)
CD SECOND ORDER EFFECTS
• Overall development costs reduced by ~40%
• Programs under development increased by ~140%
• Development costs per program reduced by 78%
• Resources driving innovation increased by 5x
![Page 75: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/75.jpg)
CANARY RELASES
![Page 76: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/76.jpg)
PUSHING IN MULTIPLE PHASES• latest - a version of the site running the latest code at all time. Employees
would use this site and find any major bugs almost instantly.
• p1 - a handful of servers that would be the first to run the new code in production. The goal of this was to catch any obvious fatals/warnings in the logs before a new release would gain wide distribution.
• p2 - a larger set of servers on the web tier. The number of servers in p2 increased over time, but I believe hovered around 5% or so. This offered several opportunities, including catching long tail fatals and monitoring resource use along with key user metrics on the servers for any anomalies.
• p3 - the entire web tier.
![Page 78: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/78.jpg)
3 © 2014 CA. ALL RIGHTS RESERVED.
ING: A global Financial Services Group
Over 33 million clients
40 different countries
64,000 employees of which 15,000 IT
€15 bn annual revenue
![Page 79: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/79.jpg)
54 © 2014 CA. ALL RIGHTS RESERVED.
Mobile Banking App
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
Total number of deployments per month
![Page 80: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/80.jpg)
56 © 2014 CA. ALL RIGHTS RESERVED.
Full Continuous Delivery Process with Nightly Builds
![Page 81: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/81.jpg)
60 © 2014 CA. ALL RIGHTS RESERVED.
From 1 Star to 4 Stars in the iStore
![Page 82: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/82.jpg)
63 © 2014 CA. ALL RIGHTS RESERVED.
ING Core Bank
Savings, Loans, Current Accounts
12 million accounts
10 DevOps teams
![Page 83: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/83.jpg)
64 © 2014 CA. ALL RIGHTS RESERVED.
Continuous Delivery is not just for Web Applications
One Branch
One automated test set
One CD pipeline
![Page 84: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/84.jpg)
65 © 2014 CA. ALL RIGHTS RESERVED.
Time to market from >20 weeks
To 4 days
![Page 85: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/85.jpg)
67 © 2014 CA. ALL RIGHTS RESERVED.
From 30+ outages in 2013 to 0 in 2014
While increasing releases from 4 per year to every 3 weeks
![Page 86: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/86.jpg)
• Culture
• Automation
• Lean
• Measurement
• Sharing
WHAT DEVOPS IS
![Page 88: DevOps and Cloud Native](https://reader034.vdocuments.us/reader034/viewer/2022051521/5a6708347f8b9acd178b497b/html5/thumbnails/88.jpg)
maraming salamatありがとうございます
terimah kasihdaghang salamat
thank you