Continuous deployment pipeline in 30 minutes. Mission impossible?

Automate your builds, tests and deployments to production

Fabrice Pipart, Dev/CI/CD workflows expertLoic Rouchon, Principal EngineerMay 9th 2019

Poll and Questions:

Go to:

sli.do

Event code: #cicd

Continuous deployment pipeline in 30 minutes. Mission impossible?

Fabrice PipartDev, CI, CD workflows expert

@FabricePipart

Loic RouchonPrincipal Engineer

@loicrouchon

May 9th 2019

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

Automate your builds, tests and deployments

to production

Poll and Questions:

Go to: sli.do

Event code: #cicd

3

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

Who are we?echo $(whoami)

@FabricePipart @loicrouchon

Survey and Questions : sli.do #cicd

4

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

Amadeus?groups $(whoami) | grep $(id –g -n)

Amadeus provides the technology which keeps the travel sector moving - from initial search to making a booking, - from managing reservations to managing check-in and departure

We design and develop and maintain some of the world's most complex, real time information systemsWe design and operate our own data centers

- 1.6+ billion transactions per day- ~0.5 billion bookings per year- 95% of the scheduled airlines- 195 countries

Survey and Questions : sli.do #cicd

5

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

Amadeus DigitalLarge scale frontend deployments

7M lines

of code

1 billion page views per month

2000 +

Hits / second

www

Hundreds

JBoss

SOAP

REST

300+ libraries

Dozens of

webapps

Survey and Questions : sli.do #cicd

Cloud

Open Source

Development, CI and CD workflows with Openshiftquality++; time_to_market-- && operability++

Increase Quality

_ Small increments_ Shift left_ Short feedback loop

Tests

Faster time to market

_ Accelerate tests_ Automate tests_ Automate deployments

Advanced Operability

_ Consistent environment_ Automated tests platform

creationSurvey and Questions : sli.do #cicd

7

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

NB: this is the actual first hit for a

’’praise demogods’’ search

Time to praise the demo godsmore /demo/live.sh

Survey and Questions : sli.do #cicd

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

What do you plan to do during the next 30 min?sleep 1800

Building a production assembly chain

Pieces Garage Workshop Test Factory

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

Credits: Taverne Motorcycle

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

16

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

What did we just see?Continuous Integration and Continuous Deployment using Openshift

Laptop

Hard

war

e st

ack

Soft

war

e st

ack Artifactory

Production environmentValidation environment

Build Run

Test

ADK

Build Run Run

BitBucket

Test

• How to build• How to deploy• How to test

• Docker images• OC Template• Deployment

pipeline• Tests

Development Validation Production

Jenkins

Pipeline libraries

17

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

How does it apply to real life?top | grep reality

Very rich

libraries and

workflows

More tests

types

More

complex

Jenkinsfile

Subsystem

isolation

Internal

Communities

Longer

builds

Aiming at

automatic

prod

deployment

Improve

testing

Credits: Taverne Motorcycle

Migrations

ongoing

Metrics in

Grafana

What we learned along the waycat experience | grep lessons

Pipeline libraries

Externalize complexityMutualize maintenance

Standardize workflowsShare experience

Prepare for

failure

Quick feedback loopSystems will go down

Retry mechanismsAuto healing mechanisms

Pipeline is Prod code

Clean Well designed

ExtensibleTested

Scale2nd biggest BitBucket clusterThousands daily workflow builds

85TB in Artifactory (x9 sites)Growing exponentially

19

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

Stric

tly

CONFIDENTIAL

Thank you!

© A

ma

de

us

IT G

rou

p a

nd

its

aff

ilia

tes

an

d s

ub

sid

iari

es

You can follow us on:

AmadeusITgroupamadeus.com

amadeus.com/blog