using tensorflow with amazon sagemaker marketing... · automatic model tuning—early stopping | ip...

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMMIT

Using TensorFlow with Amazon SageMaker

Yuval FernbachSpecialist Solutions Architect – ML, EMEA

A I M 3


Agenda

• The Amazon ML Stack

• What is Amazon SageMaker

• TensorFlow with Amazon SageMaker• SageMaker script mode

• Collecting training metrics

• Experiments tracking with SageMaker search

• Performance optimization• SageMaker pipe input

• Distributed training


Our Approach for Machine Learning

Customer-focused 90%+ of our ML roadmap is

defined by customers

Multi-frameworkSupport for the most popular frameworks

Pace of innovation200+ new ML launches and major

feature updates in the last year

Breadth and depthA wide range of AI and ML services in-

production

Security and analyticsDeep set of security and

encryption features, with robust analytics capabilities

Embedded R&D Customer-centric approach to advancing the state of the art

SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Put machine learning in the

hands of every developer

Our mission at AWS


Some of our machine learning customers…

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMMIT© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Trademark

M L F R A M E W O R K S &

I N F R A S T R U C T U R E

The Amazon ML Stack: Broadest & Deepest Set of Capabilities

A I S E R V I C E S

R E K O G N I T I O N

I M A G E

P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D

& C O M P R E H E N D

M E D I C A L

L E XR E K O G N I T I O N

V I D E O

Vis ion Speech Chatbots

A M A Z O N

S A G E M A K E R

B U I L D T R A I N

F O R E C A S TT E X T R A C T P E R S O N A L I Z E

D E P L O Y

Pre-bui l t a lgor ithms & notebooks

Data label ing (G R O U N D T R U T H )

One-cl ick model t ra in ing & tuning

Opt imizat ion ( N E O )

One-cl ick deployment & host ingM L S E R V I C E S

F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e

E C 2 P 3

& P 3 d n

E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C

I N F E R E N C E

Reinforcement learningAlgor ithms & models ( A W S M A R K E T P L A C E

F O R M A C H I N E L E A R N I N G )

Language Forecast ing Recommendat ions


Amazon SageMaker: Build, train, and deploy ML

1

2

3

1

2

3


Pre-configured environments to quickly build deep learning applications


AWS is framework agnostic

Choose from popular frameworks

Run them fully managed Or run them yourself


The best place to run TensorFlow

Fastest time for TensorFlow

65% 90%

30m 14m

• 85% of TensorFlow workloads in the cloud runs on AWS (2018 Nucleus report)

• Available w/ Amazon SageMaker and the AWS Deep Learning AMIs


What is TensorFlow?

TensorFlow™ enables developers to quickly and easily get started with deep learning in the cloud.

The framework has broad support in the industry and has become a popular choice for deep learning research and application development, particularly in areas such as computer vision, natural language understanding and speech translation.

https://aws.amazon.com/deep-learning/


Running TensorFlow on SageMaker

• SageMaker Python SDK – Open source APIs that make it easy to train and deploy models in Amazon SageMaker• Documentation - https://github.com/aws/sagemaker-python-sdk

https://github.com/aws/sagemaker-python-sdk


Training with Script Mode


Training with Script Mode

SageMaker will call the entry_point


Training Metrics

The SageMaker Python SDK allows you to specify a name and a regular expression for metrics you want to track for training.

A regular expression (regex) matches what is in the training algorithm logs, like a search function.


SageMaker Pipe Mode

Dataset is streamed directly to your training instances instead of being downloaded first.

This means that your training jobs :

• start sooner

• finish quicker

• need less disk space


Distributed Training

• Types of distributed training• parameter server

• Horovod

Thank you!


Yuval FernbachSpecialist Solutions Architect – ML, EMEA

using tensorflow with amazon sagemaker marketing... · automatic model tuning—early stopping | ip...

Documents