red hat dallas emerging tech summit · 2020. 1. 10. · red hat dallas emerging tech summit - dec...

Red Hat Dallas Emerging Tech Summit

AI and ML on Kubernetes William Benton • Engineering Manager and Senior Principal Engineer

December 5, 2019

@willb

What is machine learning?

RED HAT DALLAS EMERGING TECH SUMMIT - DEC 5, 2019

feature engineering

model training

and tuningmodel

validationmodel

deploymentmonitoring,

validationdata

collection and cleaning

codifying problem

and metrics

codifying problem

and metrics

codifying problem

and metrics

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

codifying problem

and metrics

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

codifying problem

and metrics

data collection

and cleaning

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

numquam sit. Est sunt eum rerum cumque rerum quia numquam. Et necessitatibus quo blanditiis dolorem quia id qui.

A delectus enim id accusamus quia. Omnis possimus enim ea velit repudiandae id. Et placeat ipsam reiciendis quia ipsam accusantium in. Minima velit ut eos doloremque pariatur provident voluptatem placeat.

Enim ut recusandae eos ad sit architecto ut et. Maiores nihil quae eius sit. Nobis nobis sint sint sequi sed alias quod. Commodi autem neque numquam optio et aut id.

Impedit quo id dolorum debitis qui omnis. Et ipsa animi ab ipsa blanditiis consequatur. Est consequatur cumque minima nesciunt sint. Illum rerum minus odit qui.

In quia excepturi adipisci. Maxime aut est libero atque quod. Voluptatum quae quos occaecati expedita qui impedit sunt nisi. Qui quod eligendi provident.

Quia est sint ex officiis et non fugiat nihil. Neque eum et doloremque et totam quis ut explicabo. Ipsam animi consequatur rerum doloremque est amet et eaque. Ut voluptatibus nisi commodi.

codifying problem

and metrics

data collection

and cleaning

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

codifying problem

and metrics

feature engineering

data collection

and cleaning

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

codifying problem

and metrics

feature engineering

data collection

and cleaning

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

codifying problem

and metrics

feature engineering

data collection

and cleaning

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

codifying problem

and metricsfeature

engineering

model training

and tuning

data collection

and cleaning

feature engineering

model training

and tuningmodel

validationmodel

validationdata

codifying problem

and metrics

data collection

and cleaning

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

feature engineering

model training

and tuningmodel

validationdata

model deployment

monitoring, validation

codifying problem

and metrics

data collection

and cleaning

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

model deployment

feature engineering

model training

and tuning

data collection

and cleaningmodel

validationmodel

validationcodifying problem

and metrics

codifying problem

and metrics

feature engineering

model training

and tuning

model validation

data collection

and cleaning

model deployment

feature engineering

model training

and tuning

data collection

and cleaningmodel

validationmodel

and metrics

codifying problem

and metrics

feature engineering

model training

and tuning

model validation

data collection

and cleaning

model deployment

data as the foundation

@willb

Why “on Kubernetes?”

codifying problem

and metricsfeature

engineeringmodel

training and tuning

data collection

and cleaningmodel

validationmodel

and metricsfeature

engineering

model training

and tuning

model validation

data collection

and cleaning

model deployment

feature engineering

model training

and tuning

model validation

model deployment

data collection

and cleaning

codifying problem

and metrics

feature engineering

model training

and tuning

model deployment

OpenShift is enterprise Kubernetes with a great developer experience.

declarative deployments; resource managementfor apps and compute

efficient isolation, secure by default

workflows to accelerate discovery

@willb

Some common concerns for AI/ML systems

0 0 0 1 1 0 1 0 1 0

0 0 1 0 0 0 1 1 0 0

1 0 1 1 0 1 0 0 0 0

0 0 0 0 0 0 1 1 0 1

0 1 0 0 1 0 0 1 0 0

1 0 0 0 0 1 0 1 1 0

0 0 1 0 1 0 1 0 0 0

0 1 0 0 0 1 0 0 1 1

0 0 0 0 1 0 0 1 0 1

1 1 0 0 0 0 0 0 0 1

0.13 0.13

0.06 0.07

0.07 0.06

0.02 0.08

0.17 0.11

0.11 0.09

0.04 0.18

0.13 0.04

0.13 0.21

0.14 0.03

more storage

sensitive data

more CPUsbetter GPUs

distribution of input data?

distribution of predictions?

distribution of number of multiplications while scoring?

(joint)

@willb

Intelligent applications are machine learning systems

federate

trainmodels

events

databases

file, object storage

management

web and mobile

reporting

developer UItransform

transform

archive

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

data engineers

federate

events

databases

transform

archive

data scientists

federate

trainmodels

transform

application developers

federate

trainmodels management

web and mobile

reporting

transform

archive

data scientists

application developersdata engineers

federate

trainmodels

events

databases

management

web and mobile

reporting

transform

archive

data scientists

application developersdata engineers

federate

trainmodels

events

databases

management

web and mobile

reporting

transform

archive

machine learning engineers

@willb

Managing compute and data in a shared discovery environment

OpenShift

@willb

There’s no one-size-fits-all architecture for AI/ML

OpenShift

OpenShift OpenShift

OpenShift

@willb

From developer experience to data scientist experience(s)

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

@willb

Conclusions

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

codifying problem

and metricsfeature

engineeringmodel

training and tuning

model validation

data collection

and cleaningmodel

validation

red hat dallas emerging tech summit · 2020. 1. 10. · red hat dallas emerging tech summit - dec...

Documents

safer dallas better dallas

rh319: red hat enterprise virtualization with exam · red...

red hat cloudforms 4.1 red hat cloudforms rest api · red...

1 green hat red hat yellow hat blue hat white hat black hat

red hat openstack platform red hat cloudforms red hat

your emerging career: the dallas cowboys

texas emerging technology fund – north texas regional...

esomar white hat black hat lfm

red hat linux 9 red hat linux security...

galleria dallas dallas, texas 75240

pro hat aanh hat - pmwelfareschemetn.in

red hat storage day dallas - why software-defined storage...

2007 ieee dallas engineering in medicine and biology …...

blue hat, green hat

kubernetes native with quarkus - red hat · 140 mb rest....

from distributed systems to data science · from...

red hat storage day dallas - defiance of the appliance

exchange rate arrangements for emerging east asia ·...

the path to the cloud training - matrix.co.il hat may...

black hat squad b #7 black hat squad c #5 black hat squad...