docker, kubernetes, and mesos: compared

DOCKER, KUBERNETES, AND MESOS: COMPARED.Adrian Otto, Distinguished Architect

DISTINGUISHED ARCHITECT, RACKSPACE PTL, OPENSTACK MAGNUM COORDINATOR, DOCKER LOS ANGELES MEETUP

ADRIAN OTTO

3

Outl ine

Apache MesosMulti-Framework orchestration solution for containers

KubernetesGoogle’s point of view on container orchestration

Docker SwarmThe native Docker clustering solution

Liquids, Carina, and OpenStack MagnumWhy Magnum has a perspective of different container software

LIQUIDS TAKE ON THE SHAPE OF THEIR CONTAINER. THE LIQUID STATE OF MATTER IS AN INTERMEDIATE PHASE BET WEEN SOLID AND GAS. LIKE THE PARTICLES OF A SOLID, PARTICLES IN A LIQUID ARE SUBJECT TO INTERMOLECULAR ATTRACTION; HOWEVER, LIQUID PARTICLES HAVE MORE SPACE BET WEEN THEM, SO THEY ARE NOT FIXED IN POSITION.

PROPERTIES OF MATTER: L IQUIDS

Image FPO

42

MAKE A BIGGER CONTAINER?

Image FPO

‹#›7

O p e n P O W E R a n d O p e n C o m p u t e

3 . 1 - 4 . 1 G H z C P U

~ 2 0 0 G i B / s e c M e m o r y B a n d w i d t h

> 2 0 0 M i B C a c h e

1 2 8 - 1 9 2 C P U T h r e a d s U p t o 2 T i B o f R A M

BARRELEYE

Image FPO

8

B i g g e r h a r d w a r e a l l o w s f o r b i g g e r s o f t w a r e44

APPLICATION CONTAINERS

MORE COMPUTE

CONTAINERS ARE DISRUPTIVE

An easy-to-use and instant-on

native container environment.

getcarina.com Free Beta available today.

17

Outl ine





18

2010: OpenStack is Born

+ =

www.rackspace.com !19

OP

EN

STA

CK

S

ER

VIC

ES

KeystoneGlanceNova

NeutronSwiftCinder Designate Ironic

HorizonBarbicanCeilometer

SaharaTroveHeat Magnum Marconi Murano

Layer 4: Consumption Services

Layer 3: Optional Enhancements

Layer 2: Extended Infrastructure

Layer 1: Base Compute Infrastructure

Solum

OPENSTACK MAGNUM Infrastructure + Containers

BARE METALVM

DOCKER

OPENSTACK

KUBERNETES

MESOS

MAGNUM

DOCKER API

K8S API

MAGNUM OVERVIEW

Understanding Magnum Resources (1/2)

• Click to edit Master text styles – Second level • Third level – Fourth level o Fifth level

23

Container

Bay

Node

All Magnum Bays

Understanding Magnum Resources (2/2)

• Click to edit Master text styles – Second level • Third level – Fourth level o Fifth level

24

Container

Bay

NodeKubernetes Bays

Pod

Service

What OpenStack Magnum Of fers

• Docker Swarm

• Kubernetes

• Multi-Master

• Apache Mesos

• Marathon

Choice of COE

• TLS Between Client and Magnum API

• TLS Between Bay Master and Minion/Slave/Worker

• Certificate generation/signing

• docker / kubectl TLS interoperability

Secure Bays (TLS)

• Neutron LBaaS Integration

• Automatically add or remove nodes from Neutron LB when Kubernetes bay is scaled

Load Balancer Integration

• Virtual Machines

• Bare Metal

Choice of Compute Type

25

M a g n u m S t a t i s t i c s , S t a t u s , a n d D i v e r s i t y

www.rackspace.com

5777patch sets

1514commits

267,623lines of code

1year

122engineers

34affiliations

2015-01-20released

DOCKER SWARM?

KUBERNETES?

APACHE MESOS?

WHICH COE?

CHOOSE YOUR OWN ADVENTURE

IMPERATIVE Explicit Instructions

The system is stupid, you are smart

Ultimate Flexibility

DECLARATIVE Describe the Outcome

The system is smart, you don’t care

Limited Flexibility

30

Outl ine





DOCKER SWARM

Swarm Manager

Swarm Node

Docker Client

Docker Daemon

Swarm Node

Docker Daemon

Swarm Node

Docker Daemon

Swarm Daemon

Discovery Service

32

Why Choose Swarm?

You have a giant clusterCluster design is extremely scalable, and easily supports thousands of nodes

Mix cloud native and legacy apps in containersRun both applications designed for the cloud, and legacy apps that were not

You prefer an imperative system (along with declarative tools)You are a badass and want to tweak what happens in your orchestration process

You like using the docker CLI, and ecosystem toolsGet the native Docker API experience and compatibility

33

Outl ine





KUBERNETESNode

Docker

Kubelet Proxy

REST API

AuthScheduler

Node

Docker

Kubelet Proxy

Node

Docker

Kubelet Proxy

35

Why Choose Kubernetes?

You have a pretty big clusterIf you have about 200 hosts or so, Kubernetes will work great for you.

You only care about cloud native applicationsYour web and mobile app workloads were built for the cloud.

You prefer an declarative systemYou don’t want to change what happens in your orchestration process.

You are a Google fanGoogle knows WTF they are doing with containers. Why second guess it?

36

Outl ine





APACHE MESOS

Mesos Master

StandbyZK

StandbyZK

Mesos Slave

Framework A

Executor

Task

Mesos Slave

Framework B

Executor

Task

LeaderZK

Apache Mesos

38

Why Choose Apache Mesos?

You have a 10,000+ node clusterCluster design is extremely scalable, and easily supports thousands of nodes

You want to schedule multiple giant workload types concurrentlyYou will run Hadoop, and Marathon, and Chronos, and maybe Kubernetes all together.

You have an infrastructure teamYour IT department employs a team of distributed systems specialists.

You are a Big Data houseYou have a lot of job oriented or task oriented workloads.

Apache Mesos

Choose Your Own Adventure!

39

You ==

badass?

Apache Mesos

No

Yes

Legacy Apps? No

Yes

Big Data

Shop?

Yes

No

Cluster > 1000?

Cluster > 10000?

Yes

Yes

No

Love docker

CLI?

Yes No

Cluster > 200?

No

Yes

Start

Big IT

Team?

YesNo

40

Review





O N E FA N AT I C A L P L A C E | S A N A N T O N I O , T X 7 8 2 1 8

U S S A L E S : 1 - 8 0 0 - 9 6 1 - 2 8 8 8 | U S S U P P O R T: 1 - 8 0 0 - 9 6 1 - 4 4 5 4 | W W W . R A C K S PA C E . C O M | W W W . G E T C A R I N A . C O M

© RAC K S PAC E LT D . | RAC K S PAC E® AN D FAN AT I C AL S U P P ORT ® ARE S ERV I C E M ARK S OF RAC K S PAC E U S , I N C . REG I ST ERED I N T HE U N I T ED STAT ES AN D OT HER C OU N T RI ES . | W W W.RAC KS PAC E .C OM

Thank you

docker, kubernetes, and mesos: compared

Documents