continuous platform evolution for ... - aws-community-day.de · o aws advantages • highly ... 5...

17
Add Talk title here PRESENTER | DATE Community Day 2019 Sponsors Continuous Platform Evolution for Cost Optimization GAVIN PERRIE | 09/09/19 Community Day 2019 Sponsors

Upload: others

Post on 20-Mar-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

Add Talk title herePRESENTER | DATE

Community Day 2019 Sponsors

Continuous Platform Evolution for Cost OptimizationGAVIN PERRIE | 09/09/19

Community Day 2019 Sponsors

Page 2: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

GAVIN PERRIE

Solutions Architect @ Data Reply• Cloud• Big Data• Automation• Chatbot / Voice Assistants

Page 3: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

DATA REPLY DE

DATA INCUBATOR REPLY

DATASCIENCE

MICROSTRATEGYDATA STRATEGY

AB INITIO

BIG DATA DEVELOPMENT

&DEVOPS

SERVICE OFFERINGDATA REPLY

Page 4: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

BIG DATADEVELOPMENT AND IMPLEMENTATION

USED TECHNOLOGIES

Open Source and Cloud technologies like:

o Kuberneteso NoSQLo Hadoopo Sparko Kafkao AWS

ADVANTAGES

• Highly automated solutions• Scalable solutions• Special customized

solutions• Solution-finding together

with the customer

SPECIALIZATION

• Specialized in Distributed Open Source & Cloud Technologies

• Knowledge of Architecture: Platform and Application

• Development and Implementation of Platforms and Applications

NOSQL

Page 5: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

ARCHITECTURE

FROM MONOLYTIC TO

ELASTIC, FULLY AUTOMATED

Page 6: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 1: LIFT & SHIFTBREAK THE CLOUD BARRIER

Corporate data center

AWS Cloud

…. ….

Value0

5

10

Cost

Flexibility

Maintainability

Page 7: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 2: MOVE TO EMRRESOURCE & USE CASE DECOUPLING

AWS Cloud

….

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 8: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 2: MOVE TO EMRRESOURCE & USE CASE DECOUPLING

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 9: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 3: INSTANCE OPTIMIZATIONUSE CASE OPTIMIZED INSTANCE FAMILIES

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 10: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 4: SCHEDULINGWORKING HOUR RUNTIMES

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 11: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 5: CHATBOTSELF SERVICE CLUSTER MANAGEMENT

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 12: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 6: SPOT INSTANCES

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 13: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

STAGE 7: GLUE CATALOG

AWS Cloud

EMR EMR EMR

EMR EMR

Lake

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 14: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

FUTURE ENHANCEMENTS

AWS Cloud

EMR EMR EMR

Sagemaker Notebook

Lake

Athena

nowprevious0

5

10

Cost

Flexibility

Maintainability

Page 15: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

QUESTIONS?

Page 16: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr

THANK YOUwww.reply.com

Page 17: Continuous Platform Evolution for ... - aws-community-day.de · o aws advantages • highly ... 5 10 st y y. stage 2: move to emr resource & use case decoupling aws cloud emr emr