introducing apache mesos environments in rancher - june 2016 online meetup

28
© 2015 Rancher Labs, Inc. © 2016 Rancher Labs, Inc . Introducing Mesos Environments in Rancher June 29, 2016 #ranchermeetup

Upload: shannon-williams

Post on 12-Jan-2017

588 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .

Introducing Mesos Environments in RancherJune 29, 2016

#ranchermeetup

Page 2: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.2 © 2016 Rancher Labs, Inc .

Shannon WilliamsCo-Founder/VP Marketing @smw355

Darren ShepherdCo-Founder/Chief Architect @ibuildthecloudFreenode: darren0

#ranchermeetup

Page 3: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.3 © 2016 Rancher Labs, Inc .

First things first…

This is a not a !

#ranchermeetup

Page 4: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.4

There are rules for a meetup!• We won’t be done on time• Questions are always welcome• There are no bad questions• Demo, then demo some more• Things will break, be patient

#ranchermeetup

Page 5: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.5

Join the conversation on Twitter #ranchermeetup

Page 6: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.6 © 2016 Rancher Labs, Inc .

Agenda• Introducing Mesos Environments in Rancher - Shannon• Demo: Deploying Mesos – Darren• Demo: Deploying Frameworks – Darren • Latest Rancher Update – Darren

#ranchermeetup

Page 7: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.7 © 2016 Rancher Labs, Inc .

DockerCon Update• Built-in container

orchestration introduced in Docker 1.12

• New Distributed Application Bundle format

• New Docker Store

Page 8: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.8 © 2016 Rancher Labs, Inc .

Rancher Labs

#ranchermeetup

Page 9: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.9 © 2016 Rancher Labs, Inc .

Private Container ServiceApplications

Orchestration

Infrastructure

Page 10: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.10 © 2016 Rancher Labs, Inc .

Deploy and Manage InfrastructureEnvironment: Dev-Lab

Network Services Storage Services

Host 1 Host 2 Host 3 Host n

Infrastructure

Page 11: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.11 © 2016 Rancher Labs, Inc .

Select an Orchestration ToolEnvironment: Dev-Lab

Host 1 Host 2 Host 3 Host n

Network Services Storage Services

Orchestration

Kubernetes System Services

Page 12: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.12 © 2016 Rancher Labs, Inc .

Launch Applications and ServicesEnvironment: Dev-Lab

Host 1 Host 2 Host 3 Host n

Network Services Storage Services

Orchestration

Page 13: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.13 © 2016 Rancher Labs, Inc .

Launch Applications and ServicesEnvironment: Dev-Lab

Host 1 Host 2 Host 3 Host n

Network Services Storage Services

Orchestration

Delivery Pipeline docker-compose.yml lb:  image: haproxy    links:    - webtomcat:  image: tomcat  links:    - mysqlv1    - redisredis:  image: redis  mysqlv1:  image: mysql

Page 14: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.14 © 2016 Rancher Labs, Inc .

- 1 Million+ Downloads- 1.0 Released in March- Open Source- Multi-tenant- Enterprise Support

Page 15: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .

#ranchermeetup

Introducing Mesos Environments in Rancher

Page 16: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.16 © 2016 Rancher Labs, Inc .

What is Apache Mesos?- Open Source Cluster

Manager written in C++- Frameworks provide

interface for deploying workloads

- Started in 2009 at UC Berkeley

- Well known users include Twitter, AirBNB, Apple

- Current stable release is 0.28

Page 17: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.17 © 2016 Rancher Labs, Inc .

Mesos Environments in Rancher• Automated deployment of an unlimited

number of Mesos clusters• Lifecycle management of Mesos clusters• Control user access to Mesos

environments• Mesos framework deployment from catalog• Node provisioning through Docker Machine

Page 18: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.18 © 2016 Rancher Labs, Inc .

Inside a Rancher Mesos Environment

Environment A

Mesos Master 1 Mesos Master 2 Mesos Master 3

Mesos Slave 1 Mesos Slave 2 Mesos Slave 3

Zookeeper 1 Zookeeper 2 Zookeeper 3 Mesos Slave 4

MesosSystemServices

• Slaves send resource availability to masters.• Masters publish offers of resources.

Page 19: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.19 © 2016 Rancher Labs, Inc .

Mesos Environments

Page 20: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.20 © 2016 Rancher Labs, Inc .

Mesos Control Plane

Page 21: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.21 © 2016 Rancher Labs, Inc .

Mesos Frameworks

Page 22: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.22 © 2016 Rancher Labs, Inc .

• Frameworks are how users submit jobs to the Mesos cluster

• Different types of frameworks for specific use cases

• Popular frameworks include Marathon, Chronos, Aurora, Spark, Kafka, etc.

• Frameworks include schedulers and executors

• Rancher deploys and manages frameworks as Docker containers

Mesos Frameworks

Page 23: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.23 © 2016 Rancher Labs, Inc .

Deploying Frameworks in Rancher

Environment A

Mesos Master 1 Mesos Master 2 Mesos Master 3

Mesos Slave 1 Mesos Slave 2 Mesos Slave 3

Zookeeper 1 Zookeeper 2 Zookeeper 3 Mesos Slave 4

MesosSystemServices

MarathonMesosFrameworks Chronos

• Slaves send resource availability to masters• Masters publish offers of resources. • Frameworks accept/reject offers, and sends tasks.• Tasks are executed by slaves running framework executor.

App App App

Page 24: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.24

Demo

#ranchermeetup

Page 25: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.

Latest Rancher Enhancements

25

1.1.0 - TodayNew Features (since v1.1.0-dev5)Docker 1.11.x Support Microsoft Azure AD Support Kubernetes: SSL Support (self-signed)

New Features (since v1.0.2)Machine CatalogCustom UI for Machine DriversKubernetes: Persistent Storage from EBS and GCEKubernetes: Private Registry Kubernetes: Upgrade Kubernetes: Ingress controller improvementsSupport for Internationalization framework for UI Mesos Support Support for External Load Balancers (F5 initial release) Experimental: Vault Integration

#ranchermeetup

Page 26: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.26 © 2016 Rancher Labs, Inc .

Getting StartedRancher and RancherOS are in GitHub – Get Involved!

#ranchermeetup

http://github.com/rancher

Page 27: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.27 © 2016 Rancher Labs, Inc .

New eBook: Building a CI/CD Pipeline with Docker & Rancher

http://info.rancher.com/cicd-with-docker-ebook

Page 28: Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .

Thank yourancher.com

#ranchermeetup