Upload File

state of the operators...why do we need operators? $ docker pull postgres $ docker pull redis $...

  • Home
  • Documents
  • State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers
23
State of the Operators Framework, SDKs, and beyond Daniel Messer Product Manager, OpenShift

Upload: others

Post on 12-Jul-2020

4 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

State of the Operators

Framework, SDKs, and beyond

Daniel MesserProduct Manager, OpenShift

Page 2: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

2

...and many more

https://github.com/operator-framework/awesome-operators

OPERATORS ACROSS THE INDUSTRY

Page 3: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

Why do we need Operators?

Page 4: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

Containers brought simplicity to the development world

Why do we need Operators?

$ docker pull postgres$ docker pull redis

$ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres$ docker run --name some-redis -d redis

Page 5: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

● Deployment● ReplicaSet● StatefulSet● DaemonSet● CronJob● ...

Existing operational logic in Kubernetes

Page 6: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

⏣ Resize/Upgrade

⏣ Reconfigure

⏣ Backup

⏣ Healing

Page 7: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

OK, but what is an Operator?

Page 8: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

● An operator is a kubernetes native application● Leverages the kubernetes API (usable with kubectl)● Runs on kubernetes as containers● Resembles a custom controller

● Purposely built for an application● Operational knowledge baked in and automated

● handling upgrades from one version to another● handling complex failure recovery scenarios● scaling a stateful application up and down

● Best suited for complex and stateful applications (but not only!)● Example: a prometheus operator specifically designed for it

What is an Operator?

Page 9: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers
Page 10: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

● Operator SDK - Allows developers to build, package and test an Operator based on your expertise without requiring all the knowledge of Kubernetes API complexities

● Operator Lifecycle Manager - Helps you to install, and update, and generally manage the lifecycle of all of the Operators (and their associated services) running across your clusters

● Operator Metering - Enable usage reporting for Operators and resources within Kubernetes

Page 11: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

OPERATOR FRAMEWORK IN ACTION

OPERATORSDK

KUBERNETESOPERATOR

+ =

DEVELOPER“create new operator”

scaffolding custom logic

Page 12: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

TYPES OF OPERATORS

Page 13: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

CREATE AN OPERATOR WITHOUT CODING

$ operator-sdk new cockroachdb-operator --type=helm --helm-chart stable/cockroachdb

Page 14: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

OPERATOR FRAMEWORK IN ACTION

OPERATORSDK

KUBERNETESOPERATOR

+ = +

OPERATORLIFECYCLE MANAGER

+OPERATORMETERING

DEVELOPER

ADMINISTRATOR

USER

“create new operator”

scaffolding custom logic metadata

package

“make available to”

“list packages”

“subscribe to channel”

subscriptionnamespaceoperator instance

managed application

“collect metrics”“Create application”

Page 15: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

Operator Hub - Allows administrators to selectively make operators available from curated sources to users in the cluster.

OPERATORS INOPENSHIFT

Page 16: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

COMMUNITY OPERATOR CONTRIBUTION

OPERATORSDK

KUBERNETESOPERATOR

+ =

OPERATORMETERING

DEVELOPER

COMMUNITY REPO

USER

“create new operator”

scaffolding custom logic

“browse catalog”

“install”

operator instance

managed application

“collect metrics”“Create application”

pull request

QUAY

OPERATORHUB

Page 17: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

Demo

Page 18: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

What’s ahead

Page 19: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

OPERATOR SDK & LIFECYCLE

Cross-Platform SupportObjectives: - OCP, OKD and k8s consistencyFeatures: - Universal Base Image Support - installation for non-OCP clusters Stage: Development

Operator TestabilityObjectives: - aid developers with e2e testing - validate operator maturityFeatures: - scorecard utilityStage: Prototype

Continuous TestingObjectives: - automated scorecard testing - validate operator maturityStage: Discovery

Partner EnablementObjectives: - UBI support for partners - scorecard for partnersStage: Discovery

No-Fuzz Operator InstallFeatures: - OperatorGroupsStage: Prototype

SDK

SDK

OLM

SDK

SDK

OLM

Now Next Future

TBD, ideas around over-the-air updates, operator status aggregated from operands...

Page 20: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

https://github.com/operator-framework/community-operators

Page 21: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

CPUMemoryStorage

RequestActual UsageUtilization %

PodNamespace

NodeCluster

METERING/CHARGEBACK

● Testing a developer preview now○ Install from OperatorHub

● Base functionality on all providers● Tie into cloud providers for $$● Included reports for 80% use-case

○ Customers can write custom reports and time periods

● Popular use-case: shame teams over requesting RAM

Page 22: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

Where to get started?

● https://github.com/operator-framework/getting-started

● https://github.com/operator-framework/community-operators

● https://commons.openshift.org/sig/operators.html

● #kubernetes-operators on the kubernetes slack

● https://groups.google.com/forum/#!forum/operator-framework

https://github.com/operator-framework/getting-started
https://github.com/operator-framework/community-operators
https://commons.openshift.org/sig/operators.html
#
https://groups.google.com/forum/#!forum/operator-framework
Page 23: State of the Operators...Why do we need Operators? $ docker pull postgres $ docker pull redis $ docker run --name some-postgres -e POSTGRES_PASSWORD=foo -d postgres ... Allows developers

Thank you!


BARISTA’ - people.csail.mit.edupeople.csail.mit.edu/anantb/public/docs/research/barista/barista...Architecture’ Postgres’ Postgres’ Postgres’ BaristaLib’ C++Client GO’Client

A introduction to Docker - openwriteup.com€¦ · Docker Commit Pull a new container image docker pull rhel7:latest docker run rhel7:latest /bin/bash Modify the container: touch

基于Docker swarm和Rancher来 快速实 PG PAAS私有云服务bos.itdks.com/69498aa602d74456ba2b95a2b799f21e.pdf · 2017 Postgres大象会 PGConf.CN 2017 基于Docker swarm和Rancher

Keith Paskett - Postgres on ZFS @ Postgres Open

Postgres (for non-Postgres people) · 2020-01-04 · Greg Sabino Mullane End Point Corporaon [email protected] PgCon 2010 Postgres (for non-Postgres people)

Postgres Open, September 2014: Postgres Interface Performance

SPATIAL DATA & THE SEARCH ENGINESinspire.ec.europa.eu/events/conferences/inspire...Docker Pull Command docker pull iide/ Idproxy Short Description Publish WFS services as Linked Data

Postgres Enterprise Manager Installation Guide · Postgres Enterprise Manager™ Installation Guide, Version 6.0.0 ... 2 Postgres Enterprise Manager™ ... Postgres Enterprise Manager

Splash Documentation - Read the Docs · Documentation 1.1Installation 1.1.1Linux + Docker 1.InstallDocker. Make sure Docker version >= 17 is installed. 2.Pull the image: $ sudo docker

Workshop: Singularity Containers in High …...2019/03/28  · Singularity pull 10 High Performance Computing {rgrandin@hpc-class09}> singularity pull docker://gcc:8.3.0WARNING: pull

Learn to scrap dynamic content using Docker and Selenium...For this tutorial we use Firefox ! In classic context (good internet connection), we pull images directly from the Docker

Using VMware vFabric Postgres - vFabric Postgres 9.1

Introduction to Docker - datahouse.asia · 6/7/2019  · On the right is the docker-compose.yml file This is the script to instruct docker pull the built and image from Dockerfile

Configuring EDB Postgres Advanced Server Streaming ......Configuring EDB Postgres Advanced Server Streaming Replication EDB Postgres Advanced Server 9.5 formerly Postgres Plus Advanced

CT Software Developers Meetup: Using Docker and Vagrant Within A GitHub Pull Request Workflow

docker pull electronioncollider/escalate EIC JLUO...Start the docker 3 Plan now: • Short introduction to our software • 1. Tutorial –running fast simulation • 2. Tutorial –running

Docker 101 - techccu.csie.iotechccu.csie.io/2015/slides/frank.pdf · Docker Basics - CLI Docker client docker version docker info docker search [keyword] docker push/pull/commit docker

Craig Kerstiens - Scalable Uniques in Postgres @ Postgres Open

with Cloudgene and CloudMan - Amazon S3 · Codefest 2015 •Build a Docker Image for Hadoop + Cloudgene –We integrated mtDNA-Server docker pull seppinho/cdh5-pseudo-mtdnaserver

EUBra-BIGSEA- cloud services with QoS guarantees for Big ...€¦ · $ docker pull eubrabigsea/ec3client $ docker pull grycap/im Mesos master Hadoop DN Hadoop DN Hadoop DN ... •

Postgres Enterprise Manager · Postgres Enterprise Manager, Release 7.15 This document provides an introduction to Postgres Enterprise Manager™ (PEM). Postgres Enterprise Manager

Postgres Plus Advanced Server Installation Guideget.enterprisedb.com/docs/Postgres_Plus_Advanced... · Postgres Plus Advanced Server Installation Guide Postgres Plus Advanced Server

Dockah, Dockah, Dockah - People 101 Hello, World! $> docker run rhel7 echo “Hello, World!” Fetch an image $> docker pull rhel6 List images $> docker images 29 Dockerfile Simple

Docker Docker Docker

Postgres Plus Cloud Database - EnterpriseDBget.enterprisedb.com/...Plus_Cloud_Database_Getting...Postgres Plus Cloud Database automatically provisions PostgreSQL or Postgres Plus Advanced

Postgres Enterprise Manager · 2020. 12. 8. · Postgres Enterprise Manager, Release 8.0 This document provides an introduction to Postgres Enterprise Manager™ (PEM). Postgres Enter-prise

Koichi Suzuki - Postgres-XC Dynamic Cluster Management @ Postgres Open

ambientes descartaveis docker - Amazon S3 · stage('Deploy to Staging') { when { expression { env.BRANCH_NAME == 'master' } } steps { - Criar o serviço no Docker Swarm com o Postgres

Postgres Plus Advanced Server ECPG Plus Guideget.enterprisedb.com/docs/Postgres_Plus_Advanced_Server_ecpgPlus...Postgres Plus Advanced Server ECPGPlus Guide Postgres Plus Advanced

Using VMware vFabric Postgres - vFabric Postgres 9.3 · PDF fileUsing VMware vFabric Postgres vFabric Postgres 9.3.5 This document supports the version of each product listed and supports

John Melesky - Federating Queries Using Postgres FDW @ Postgres Open

Visualizing Postgres - 日本PostgreSQLユーザ会 · Visualizing Postgres ... postgres 1 postgres 2 postgres 3 postgres 4 postgres n. reduce TPS! memcached ... track_functions*

Postgres Plus Cloud Server Getting Started Guideget.enterprisedb.com/.../Postgres_Plus_Cloud_Server...Postgres Plus Cloud Server automatically provisions PostgreSQL or Postgres Plus

Introduction to Docker - LoOPS · Hello World Fetch a docker image from the docker registry: $ docker pull busybox Using default tag: latest latest: Pulling from library/busybox cf2616975b4a:

Docker Docker Docker Chef