Download - Be Fast or Stay Behind - Building a Continuous Delivery Platform

Be Fast Or Stay Behindwww.immobilienscout24.de

Schlomo Schapiro, Systems Architect & Open Source Evangelist

Ingmar Krusch, Team Lead in Operations

License: http://creativecommons.org/licenses/by-nc-nd/3.0/

Building a Continuous Delivery Platform

http://creativecommons.org/licenses/by-nc-nd/3.0/

2

www.ImmobilienScout24.de

2 billion PI per month

2 data center with ~800 VM

~30 crossfunctional IT teams

total of ~500 employees

14 years in business

part of Deutsche Telekom

Overview File Mgmt Systems Mgmt Lessons Learned

3 Overview File Mgmt Systems Mgmt Lessons Learned

Close Collaboration

Package Deployment

4

The Big Picture – Continuous Delivery Platform

BusinessDecision

To goLive

All Humans are on the Same Side

BuildConfigDeployTestSystems-Management

Automation

Scale OutData Centers


5

1st task: Reduce Systemic Complexity

File Management

Systems Management


6

File Management with RPM & YUM


7



Libraries

Applications

Configuration

Operating System

100 %

8



PROD

DEV

InfrastructureBuild

ApplicationBuild

ConfigurationBuild

QA

YUMRepos

9



Interface

PROD

DEV

InfrastructureBuild

ApplicationBuild

ConfigurationBuild

QA

YUMRepos

10

PROD

DEV

InfrastructureBuild

ApplicationBuild

QA

YUMRepos

Configuration Build – Pre-built Config Content


ConfigurationBuild

11



SVN

commitconfig file

buildconfig RPM

RPMswithstatic

content

YUMRepo

12



SVN

RPMswithstatic

content

TemplatingVariables

Overlaying

YUMRepo

buildconfig RPM

commitconfig file

13



SVN

RPMswithstatic

content

TemplatingVariables

Overlaying

we use1 RPM

per host

YUMRepo

commitconfig file

buildconfig RPM

14

SVN

RPMswithstatic

content

TemplatingVariables

Overlaying

we use1 RPM

per host

Sharedresponsability

Ops, Dev, QA ...



YUMRepo

commitconfig file

buildconfig RPM

15

Application Build – Continuous Release Delivery


PROD

DEV

InfrastructureBuild

QA

YUMRepos

ConfigurationBuild

ApplicationBuild

16

Application Build – Package Promotion Pipeline

YUMRepo

TestedRepo

YUMRepo

ReleasedRepo

YUMRepo

ComittedRepo

DEV Pre-PROD PROD


17

Application Build – Package Promotion Pipeline

CI YUMRepo

TestedRepo

YUMRepo

ReleasedRepo

YUMRepo

ComittedRepo

Business decisionto Go Live withtested versions

DEV Pre-PROD PROD

Auto-promote release if tests OK

Deploy&

Test

Deploy&

Test


Deploy&

Test

18

Application Build – Site-wide Releases


PROD

DEV

InfrastructureBuild

QA

YUMRepos

ConfigurationBuild

ApplicationBuild

19

Team City – CI

POM



NEXUS„released“

Repo

mvn deploy

NEXUS Server

20


NEXUS„released“

Repo

yum upgrade


Team City – CI

POM

mvn deploy

NEXUS Server

NEXUS-YUMPlugin

YUM„released“

Repo

21

File Management through many YUM repositories


PROD

DEV

InfrastructureBuild

ApplicationBuild

ConfigurationBuild

QAYUMRepo

YUMRepoYUM

RepoYUMRepo

22

Systems Management with YADT


YADT – an Augmented Deployment Tool

23

YADT – Unified Dependency Tree


Web Server

HTTPD

Tomcat

App Server

Load Balancer

24

YADT – Unified Dependency Tree

Web Server

HTTPD

Tomcat

App Server

Load Balancer

web-app

httpd

config

tomcat


25

YADT – Large Scale System Management

Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config


26


LB: www.immobilienscout24.de

Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config

Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config


27



Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config

Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config

1st ch

unk


28

S: YADT – Large Scale System Management


Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config

Web Server

HTTPD

Tomcatweb-app

httpd

config

tomcat

App Server

Java App

app

config


1st ch

unk2nd chunk

29

Systems Management with YADT

Reduce Systemic Complexity


30


Decoupled Applications


31


Developers Build Infrastructure


32

This Automation is our Continuous Delivery Platform

BusinessDecision

To goLive

All Humans are on the Same Side Scale Out

Data CentersAUTOMATION


33

DevOps

We build it together as one team.

We understand it completly.

And it is fully automated.


34

Open-Source from the start

https://code.google.com/p/yadt

https://code.google.com/p/nexus-yum-plugin

http://sourceforge.net/projects/yadtdownloads





35

What is the real competitive advantage?








36

Q&A


Massively Reduce Systemic Complexity

Work As One Team

37

Kontakt:Immobilien Scout GmbHAndreasstraße 1010243 Berlin

Email: [email protected]: [email protected]: www.immobilienscout24.de

Thank you very much!Please contact us for furtherquestions and discussions.

mailto:[email protected]

Download - Be Fast or Stay Behind - Building a Continuous Delivery Platform

Top Related