architecture & operations

Pivotal Cloud Platform Deep DivePart 2: Architecture and The Operator ExperienceSani Chabi Yosyo@pivotal.io

Keith Resarkeith.resar@ctl.com @keithresar

Architecture and the Operator Experience• Pivotal Cloud Foundry Architecture

• Structured Platform for Cloud Native Apps • One Click CenturyLink Ops Manager and CenturyLink

Dashboard• The Operator Experience

Moore’s Law Of Applications The Good Old Days

– 3 applications– Physical Servers + Scripts

Present Day– 300+ applications– IAAS + CAPS

The Future– 30,000 applications– ?

PROBLEM SPACE

Plus…

And many more….

Operation agility as the secret sauce

A STRUCTURE PLATFORM

• Self-service provisioning with RBA• Many Touch points to ONE Platform• Configuration changes• Updates/upgrades• Remediation• Scale out/Scale in• Immutable environment

(Re)deploy

(Re)configure

(Re)connect

Monitor

Current State Desired

2 Key Components to Pivotal Cloud Foundry

Ops Manager/ Operations Manager: A web application that you use to deploy and manage a Pivotal Cloud Foundry PaaS

Elastic Runtime: The set of core Cloud Foundry services that are installed, upgraded and scaled via Ops Manager

Loggregator DEA Pool

Router Cloud Controller

BOSH Director BOSH Agent

UAA/Login Servers Health Manager

Service Broker Node(s)

Messaging (NATS)

Cloud Foundry Architecture Stack

Pivotal CF deployment on CenturyLink Cloud

What’s on Pivotal Cloud Foundry for an operator?

Pivotal Cloud Foundry operations

Developer Operator

Install runtime and container

Deploy to dev

Install services (db, messaging, hadoop, …)

Deploy to dev

Setup load-balancing, SSL termination and dynamic routing

Deploy to dev

Setup load-balancing, SSL termination and dynamic routing

Setup / config High Availability

Deploy to dev

Setup load-balancing, SSL termination and dynamic routingSetup / config High Availability

Setup APM

Deploy to dev

Setup APM

Setup log streaming

Deploy to dev

Setup APM

Setup log streaming

Deploy to dev

App Deployed

Setup load-balancing and dynamic routing

Setup APM

Setup log streaming

Deploy to dev

Deploy to Test

Deploy to QA

Promote to production

Scale up

Update app

Scale down

Redeploy

Unbind service

Bind service

Restart server

Change route

Scale Platform

Create service

Delete App

Blue-green deployment

Check logsscale memory

Update app server

Change JDK

Upgrade app

Setup load-balancing and dynamic routing

Setup APM

Setup log streaming

Deploy to dev

Deploy to Test

Deploy to QA

Promote to production

Scale up

Update app

Scale down

Redeploy

Unbind service

Bind service

Restart server

Change route

Scale Platform

Create service

Delete App

Blue-green deployment

Check logsEscale memory

Update app server

Change JDK

Upgrade app

Deploy to dev

The Pivotal CF way

Deploy to dev

> cf pushCloud

ControllerHealth

Manager

NATS(message

RouterApp Deployed

The Pivotal CF way

Operator Concerns Monitor the

platformHandle upgrades and updates

Plan capacity

Manage users Quotas and services

Setup High Availability

Orgs, Spaces, Users and Quotas

Self-service with RBACSOLUTION SPACE

PIVOTAL CLOUD FOUNDRY

IMMUTABLE SELF-SERVICE PROVISIONING PLATFORM

RBAC• Organization, User role, Space• New environment in seconds• SSO with your existing IP (AD,

LDAP, SAML2)

ADMIN CONTROLS• Set limits on Key resources• Set Quotas per Orgs.• Fine grained control to restrict

inbound/outbound traffic.

MARKETPLACE• Self-provisioning on services (Data

Services, mobiles services, etc.)• PCF Managed and 3rd party

provided services

What about my legacy services?

SOLUTION SPACE

Service Broker options

Service Broker

IBM DB2ORACLE DB

MongoLab

Send Grid

AppDirect

ClearDB

ETSynchronous

ORACLE DB

SOLUTION SPACE

Operator Concerns

Monitor the platform

Handle upgrades and updates

Plan capacity

Provision services, not machinesEnables continuous delivery

Cloud-agnostic view of Platform Ops

Holistic Toolchain for “rule them all"

Eliminate bespoke automation on top of config management

Why BOSH

The BOSH Architecture

Very similar to CF architecture itself

Director as analogy to Cloud ControllerDifferent CPIs exist per IaaS implementationWorkers responsible for executing tasks as dictated by Director

How about and CF?

Mobile Servicesfor Pivotal CF

ElasticSearch for Pivotal CF

CloudBees JenkinsEnterprise

Cassandrafor Pivotal CF

Click to installNo downtime updatesExplore install logs

Click to scale the platform

Built-in High Availability

Built-in Platform Monitoring

Integrated services

BOSH releases

PCF – Each Layer Upgradable with Zero Downtime

runtime layer

OS image

application layer

PCF Buildpack Apps

linux host & kernel

App container

PCF Supported

Dev Supported

Ops Supported

• Platform Provided• CVEs addressed by

Pivotal• Canary-style, zero-

downtime upgrades

• Platform or Developer Provided

• CVEs addressed by Pivotal (for Platform Provided)

• Blue/Green deployments

• Developer/App team provided

• Blue/Green deployments

Demo: How long does it take you to deploy a patch in production?

Operator Concerns

Plan capacity

Manage users quotas and services

Platform Monitoring

How do I know when to scale DEAs?How many requests each Router is servicing?

What is the current load of my Cloud Controllers?

Platform Monitoring

Collector

JMX Provider

JMX Monitoring Tool

Platform Monitoring

Collector

JMX Provider

JMX Monitoring Tool

Monitoring in Pivotal Cloud Foundry

APPLICATIONS

• CLI: cf logs <appname>• Apps Manager• ELK tile• RBAC

PLATFORM

• SYSLOG Endpoint• Configuration via Ops

Manager• Logs Search & Persistence

such as ELK• Only accessible by Admins

• Collector Component with plugins for JMX and Datadog

• Ops Metrics tile • Firehose

CS • Agentless APM• APM Integrations through

buildpacks

Operator Concerns

Plan capacity

4 Layers of built-in High Availability

Application Instance

Platform Processes

Platform VMs

Availability Zones

Platform Processes

Platform VMs

Availability Zones

App Instance HA

Blobstore

Cloud Controller

Messaging (NATS)

DEA DEA

Runtime

Health Manager

Actual State

Cloud Foundry

Platform Processes

Platform VMs

Availability Zones

Platform Processes HA

Blobstore

Health Monitor

Messaging

Health Manager

Target VM

Cloud Controller

BOSH Director

Process

Pivotal CFDEA

Agent Process

Platform Processes HA

Target VMCloud Controller

Agent ProcessRestart

Platform Processes

Platform VMs

Availability Zones

Platform VMs HA

Blobstore

Health Monitor

Messaging

Health Manager BOSH Director

NATS Agent

Cloud ControllerAgent Process

Process

Pivotal CFCloud Controller

Agent Process

Ressurector

Re-create VM

VM is missing…

Platform Processes

Platform VMs

Availability Zones

Availability Zone #2

Availability Zones

r Blobstore

Cloud Controller

Health Manager

Messaging (NATS)

Push app

Availability Zone #1

Operator Concerns

Plan capacity

And on top of all that…… something else we’ve found in

enterprises

Virtualized Infrastructure

Infrastructure-centric Operations model

Your Application Code

IaaS+ (+automation) IT Ops Team

App Team(Dev and Ops)

SOLUTION SPACE

Application-centric Operation model

IaaS+ (+automation)

IT Ops Team

App Team

PaaS Ops Team

App Team(Dev and Ops)

Emits application “dial tone”• Configuration• Runtime• Logs• Metrics• Health Management• Security

SOLUTION SPACE

THANK YOU!See you after the break!

architecture & operations

Technology

architecture-altering operations

fujitsu interstage business operations … paper interstage...

designing and building an open it operations analytics...

introduction to operations architecture ... - design …

security operations centre (soc) architecture - sigs · pwc...

vrealize operations manager reference architecture ... ·...

computer architecture & operations i instructor: hao ji

operations architecture modeling for it-driven

eece 476: computer architecture slide set #6: multicycle ...

system architecture for the army special operations forces

unit-ii computer architecture and organization … ·...

pivotal centurylink cloud platform seminar presentations:...

sourcing operations management architecture monitoring that...

n manager 7 › en › vrealize-operations-manager › 7.0...

joint session on: architecture mechanics and materials sea...

aircraft operations checklists - pixel-architecture

telecommunication networks architecture,...

architecture, infrastructure, and operations · 2021. 7....

operations architecture modeling for it-driven...

orbital express space operations architecture program