sas and open source group... · 2016-12-14 · support for sas & open source models supported...

36
Copyright © SAS Institute Inc. All rights reserved. Open Source and SAS Extending SAS and R models to Model Manager

Upload: others

Post on 15-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Open Source and SASExtending SAS and R models to Model Manager

Page 2: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Agenda Open source and SAS

• The Analytics Lifecycle and Open source

• How SAS embraces/extends Open source

• Demo example (Model Manager)

• Open Source Support Summary and Questions

Page 3: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

The Analytic Lifecycle

RegulatedAutomated

GovernedEmbed

ReliableDecisions

ConsistentDocumented

Actions IT

Lots of DataNew DataExperimentationFail FastTest & LearnInteractiveIterative Innovation FlexibilityData Science

Discovery & Development of

Analytics

Deployment & Execution of Analytics

EXPLORE

PREPARE

MODEL MONITOR

EXECUTE

INVENTORY

ASK

Page 4: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

USE SAS to integrate R

R MODELS

SAS MODELS

Why?• Model Comparison• Leverage R for new algorithms• Ensemble Modelling• Generate Score Code• Deploy R models

EXTEND

Page 5: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Productivity

SAS Models (4) Open Source (2)Gradient Boost

Compare 7 modelsChoose champion

Inventory ModelGenerate score code

Deploy in database/Hadoop

EXTEND

What happens if this replicates to many analytical projects?

Page 6: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

!!!???!!!

The ‘IT’ folksThe ‘Analytics’ folks

I have 200 models that are deployment-ready. Can can you help me

manage them?

You have many models,…now what?

How do you deploy models?

Page 7: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

EXTEND

How SAS Extends…• Central model management platform• Repository for SAS Models and Open

Source (R, Python, PMML)

• Model History• Version control • Model and data lineage• Model Governance

THE ANALYTIC LIFECYCLE

What customers want?• Model Management platform• Inventory ALL models• Know who’s working on what• Ability to deploy models• Auditable models

MONITOR

Discovery & Development of Analytics Deployment & Execution of Analytics

PREPARE

DATAEXPLORE MODEL INVENTORY EXECUTE MONITOR

Page 8: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Model Inventory EXTEND

SAS and Open Source models

Model Metadata

Model lineage

Model inventory and search

Page 9: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

EXTEND

How SAS Extends…• Model execution platform • Execute models as database functions

(UDP or via Embedded Process)

• No Language Conversion• Purpose built model execution engines

THE ANALYTIC LIFECYCLE

What customers want?• Deployable analytics• Automation• Faster time to model execution• In Hadoop/Database model execution

MONITOR

Discovery & Development of Analytics Deployment & Execution of Analytics

PREPARE

DATAEXPLORE MODEL INVENTORY EXECUTE MONITOR

Page 10: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Model executionEXTEND

Model Publishing and automation

In Hadoop/database deploymentModel Score Code Creation

Page 11: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

EXTEND

How SAS Extends…• Model performance platform to keep

models “fresh”• Compare Multiple Models at once• Assess model accuracy (Lift, ROC, K-S)

• Champion/Challenger modeling• Model Retraining including open source

THE ANALYTIC LIFECYCLE

What customers want?• Best possible models• Model tournaments• Visibility into performance• Easy retraining• Champion/challenger modelling

MONITOR

Discovery & Development of Analytics Deployment & Execution of Analytics

PREPARE

DATAEXPLORE MODEL INVENTORY EXECUTE MONITOR

Page 12: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Model performanceEXTEND

Monitor data drift

Retrain models

Model comparisons

Model performance reports

Page 13: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

DemonstrationModel Manager

Page 14: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Support for SAS & Open Source models

Supported

PMML

Non-

PMML

Inventory n n n n

Publish &

Score

Batch n n n n

In-Database n n n n

Web Service n n n n

Streaming n n n n

Monitor n n n n

Retrain n n n n

n Supported via customization

n Supported

n Not supported

Page 15: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Thank [email protected]

Page 16: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

AppendixScreen Shots

Page 17: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 18: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 19: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 20: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 21: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 22: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 23: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 24: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 25: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 26: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 27: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 28: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 29: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 30: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 31: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 32: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 33: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 34: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 35: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 36: SAS and Open Source Group... · 2016-12-14 · Support for SAS & Open Source models Supported PMML Non-PMML Inventory n n n n Publish & Score Batch n n n n In-Database n Web Service

Copyright © SAS Inst itute Inc. A l l r ights reserved.