enterprise cloud adoption strategies

Presenter Name, Title and or Date

Cloud MonitoringOpportunities, Issues, Success Strategies

Lee Atchison Principal Cloud Architect and Advocate | New Relic

1Confidential ©2008-15 New Relic, Inc. All rights reserved.

Who am I?


28 years in industry- 7 in Amazon Retail & AWS

(Built 1st AppStore, AWS Elastic Beanstalk)

- 4 in New Relic(Architecture Lead, Cloud, Service Migration)

Specialize in:- Cloud computing

- Services & Microservices

- Scalability, Availability


Progressions in Cloud Adoption Enterprise ITCloud Adoption

Strategy

When and how enterprises decide to use the cloud…

Experiment

Secure the Cloud

Enable Servers, Enable SaaS

Enable Value-Added Services

Enable Unique Services

Mandate Cloud Usage


Progressions in Cloud Adoption

Standard stepsmost companies

follow

Enterprise IT Cloud Adoption Strategy

Experiment

§ Non-evasive, safe technologies- S3- Perhaps: CloudFront, SQS, SES

§ Stay away from EC2/Servers§ Security: Easy as one-offs§ No “Policies” implemented yet§ “Just seeing what this is all about”




Secure the Cloud

§ IAM (Credentials)

§ VPC (Secure network)

§ AWS Direct Connect (just another data center)

§ Cloud policies begin to be formed§ Critical evolution point




§ EC2- Basic “data center migration”- Just another server type available…

§ Multiple AZs/Regions- Part of multi-datacenter resiliency strategy

§ Independently: SaaS usage increases- Non-critical or internal uses first




§ Managed Databases- RDS, Aurora

§ Other Managed Services- Elastic Beanstalk, SES, SQS, ElasticSearch




§ High value, Cloud-specific services- Lambda, Kinesis- SWF, Elastic Transcoder- Redshift

§ Point of commitment......dependent on cloud



Mandate Cloud Usage

§ Cloud as a data center replacement§ Company is now “all in” with cloud§ Netflix…

Experiment

Secure the Cloud




Mandate Cloud Usage



Different CompaniesDifferent SpeedDifferent Needs


Application ITCloud Adoption

Strategy

Application owners go thru similar process


Cloud Servers

Managed Components

Unique Components

Peripheral Usage

Application Cloud Committed


Parallel process for application owners


Application IT Cloud Adoption Strategy

Peripheral Usage

§ S3- Large file storage- Hosting file downloads

§ CloudFront…



Cloud Servers

§ EC2 as a server choice- Data center migration- Often done when apps need a hardware refresh- Redundant data center

§ Application doesn’t change, just where it runs



Managed Components

§ RDS for databases§ ElastiCache, SES, ELB§ Elastic Beanstalk§ More DevOps issue than Application



Unique Components

§ DynamoDB§ ElasticSearch§ SNS, SWF§ Application is distinctly changing

- Rewritten for the cloud



Application Cloud Committed

§ Lambda§ Data Pipeline§ Kinesis§ Machine Learning§ Using cloud-unique capabilities

- Cloud provider specific- Close tie to specific cloud provider

Cloud Adoption Strategies

Application CloudAdoption Strategy

§ Peripheral Usage

§ Cloud Servers

§ Managed Components

§ Unique Components

§ Application Cloud Committed

Enterprise IT CloudAdoption Strategy

§ Experiment

§ Secure the Cloud

§ Enable Servers, Enable SaaS

§ Enable Value-Added Services

§ Enable Unique Services

§ Mandate Cloud Usage

ApplicationAdoption

CorporateAdoption Cloud Adoption

Mandate

Committed

Allow Value-Added

Allow SaaS

Allow Servers

Secure

Experiment

Experiment Servers ManagedComponents

UniqueComponents

Committed

Mandate

Committed

Allow Value-Added

Allow SaaS

Allow Servers

Secure

Experiment


UniqueComponents

Committed

Technologies Available

S3

IAMVPC

Non-IntegralSaaS

EC2

IntegralSaaS

RDSSES

LambdaKinesis

ApplicationAdoption

CorporateAdoption

AdoptionSweet Spot

First Steps

ApplicationAdoption

CorporateAdoption

Mandate

Committed

Allow Value-Added

Allow SaaS

Allow Servers

Secure

Experiment


UniqueComponents

Committed

Cloud AdoptionCenter of Gravity

IntegralSaaS

RDSSES

LambdaKinesis

AdoptionSweet Spot

First Steps

ApplicationAdoption

CorporateAdoption

Mandate

Committed

Allow Value-Added

Allow SaaS

Allow Servers

Secure

Experiment


UniqueComponents

Committed

S3

IAMVPC

Non-IntegralSaaS

EC2Cloud Adoption

Center of Gravity

ApplicationAdoption

CorporateAdoption Application Types

Mandate

Committed

Allow Value-Added

Allow SaaS

Allow Servers

Secure

Experiment


UniqueComponents

Committed

CriticalApplications

NewApplications

Non-Critical/Internal

ApplicationsStep #1

Step #2

Step #4

First Steps

ApplicationRe-Writes

Step #3

Smaller andcloud-centric

companies often start here

IAMVPC

Non-IntegralSaaS

EC2

IntegralSaaS

RDSSES

LambdaKinesis

ApplicationAdoption

CorporateAdoption Application Types

Mandate

Committed

Allow Value-Added

Allow SaaS

Allow Servers

Secure

Experiment


UniqueComponents

Committed

CriticalApplications

NewApplications

Non-Critical/Internal

ApplicationsStep #1

Step #2

Step #4

First Steps

ApplicationRe-Writes

Step #3

S3

Adoption Success Strategies

Understand where your culture is

Consciously plan your

acceptance

Drive your cultural change

to your desired level

Monitor your adoption

Understand your needs

Monitor Your Adoption

Before Migration

Baseline application(servers, databases, caches, applications,

microservices)

Determine your steady state


During Migration

Incorporate cloud’s internal monitoring

Continue application monitoring

The Biggest Role Monitoring Plays In Migration

Performance Post Migration & During Optimization

Pre-migration Feasibility & Benchmarking

Continue Monitoring…

Infrastructure is now out of your control

Some cloud specific concerns

(EC2 instance failures, instance degradation)

Understand application

impact

Ongoing application & infrastructure monitoring is

essential


What should you monitor?Cloud Monitoring


Typical Ec2 Instance§ Application & Application Microservices§ Server OS§ Hardware (virtual)

Typical Application Stack

EC2 Instance

Application & Application

Microservices

Server OS

Server (Virtual)Hardware

CloudWatch§ Monitors:– EC2 instance– Virtualization– Hardware– [CPU/Disk/Networking]

§ Doesn’t know about:– Server OS– Memory/Filesystem– Processes– Application• Latency• Error rates• Internal insights

AWS Monitoring

EC2 Instance


Microservices

Server OS


CloudWatch

AWS CONSOLE

New Relic§ Monitors (Server):– How O.S. is performing– Processes– Hardware

§ Monitors (Application):– App health– App performance– Microservices

§ Doesn’t know– Virtualization

New Relic Monitoring

EC2 Instance


Microservices

New RelicApplicationMonitoring

Server OS


New RelicServer

Monitoring

CloudWatch

AWS CONSOLE

DASHBOARDS

New Relic§ Plugins– Infrastructure visibility– Databases– Load Balancing– Networking– External services

Visibility into CloudWatch§ AWS metrics on

New Relic Dashboards

AWS çè New Relic work together

EC2 Instance


Microservices


Server OS


New RelicServer

Monitoring

CloudWatch

AWS CONSOLE

DASHBOARDS

AWS/CloudWatch§ Visibility into virtualization§ CPU/Disk/Networking

New Relic§ CPU/Disk/Networking§ Memory/Filesystem§ Processes§ Infrastructure components§ Application/Microservices:– Latency– Error rates– App insights

AWS çè New Relic work together

EC2 Instance


Microservices


Server OS


New RelicServer

Monitoring

CloudWatch

AWS CONSOLE

DASHBOARDS New Relic monitors

CloudWatchmonitors

Presenter Name, Title and or Date

Thank You

Lee Atchison Principal Cloud Architect and Advocate | New Relic


Architecting for ScalePublished by: O’Reilly Media, Available: May 2016www.architectingforscale.com

@leeatchison leeatchison

New Relic Enables Accountability Between Your Code & AWS

Customers

Mobile / Apps / Browser

On-Premises

On Premises Relational Data

AWS Responsibility:

• Service Availability & Performance

• Provisioning & operation of DC

• Isolation & security of resources

• Service maintenance & innovation

EC2

AWSContainer Service

AWS RDSSynthetic Customers

S3

NoSQL

AWS Storage Services

Your Responsibility:

• Application code & 3rd party services

• App architecture

• Customer experience

• On-premises components

enterprise cloud adoption strategies

Presentations & Public Speaking