aws re:invent 2016: get technically inspired by container-powered migrations (gpssi403)
TRANSCRIPT
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Todd Gleason, Mandus Momberg
November 29, 2016
Get Technically Inspired by
Container-Powered Migrations
SI Technical Track: GPSSI403
Please Meet
Mandus MombergPartner Solutions Architect
Todd GleasonExecutive Cloud Strategist
Seattle, We Have a Problem...
"It was the best of times, it was the worst of times."- Charles Dickens, A Tale of Two Cities
We Have To Get Better at This…
“The broader your vision, the clearer your purpose”- Jeff Smith
CEO, Suncorp
https://aws.amazon.com/solutions/case-studies/suncorp/
Let’s Solve a Problem…
Traditional migrations
Slow
Easily blocked
Expensive
Difficult to assign correct
resources
Full of friction
Linear workflows
Monolithic, problem-specific
solutions
Containerized migration
Fast
De-coupled
Pay when you use
Each team owns their own
resources
Asynchronous
Dynamic workflows
Reusable, problem -agnostic
solutions
What to Expect from the Session
A quick recap of migration
Why we like containers and you should too.
Now we build migration factories
See how a friend of ours did it in the real world
Migration
The AWS Cloud Migration Process
Migration cost considerations
- Labor
- Process
- Technology
Breaking Down the Economics
Team Setup: Workload-Oriented Sprint Model
Sprint 1 Sprint 2 Sprint 3
Timeline
Sprint 4
Mon
Sample Sprint Schedule
Tue Wed Thu Fri Sat/
Sun
Plan /
DesignMigrate
Cut
over
Discover
/ AnalyzeOrdered Backlog
2 Applications 4 Applications 6 Applications 6 Applications
App 1App 2App 3App 4App 5
App n
Team Setup: Activity-Oriented Sprint Model
Timeline
Design & Plan
Migrate
Integrate
Validate
Ordered Backlog
App 1App 2App 3App 4App 5
App n
App Group 1 10 Apps
App Group 1
App Group 1
App Group 1
App Group 2 15 Apps App Group 3 20 Apps App Group 4 20 Apps
Tracking the Migration Process.
• Range of tools
• Difficult to set up
• Time-consuming
• Tedious to maintain
• Hard to scale
• Static
Add a dash of container
• Range of tools
• Reusable Images
• Fast set up
• Simple to maintain
• Built for scale
• Dynamic
Containers
Why We Like Containers
Speed and agility
Ease of use
Ephemeral
Scalable
Efficiency
Migration Factories
What Is It?
A migration factory is a reproducible workflow of items which
enables your teams to easily transition their applications into
new environments.
Business factory
• Governs every micro factory
• Business rule-oriented
• Dependency mapping and
control
Two Key Concepts for Today
Micro factory
• Independent from other micro
factories
• Tailored for team-specific
migration
• Short-lived
• Technical governance (DR /
HA)
Business Factory
Rehost Micro Factory
Serverless Micro Factory
Let’s Hear From Our Partners
SAP Hybris in Docker Containers
Aater Suleman
Co-Founder & CEO Flux7
Faculty, UT Austin
Cloud and DevOps Solutions
Headquartered in Austin, Texas
Containers@AWS Projects at Flux7
2013 2014 2015 2016
Dev Environments
DockerCon’14
50+ successful Docker projects on AWS since 2013, some famous ones:
New App Marketplace
AWS Summit Santa
Clara 2016
HIPAA-compliant IoT
AWS re:Invent’14 Keynote
PCI Compliant Setups
AWS Summit 2016 and AWS Re:invent
2016
Multi-tenant IoT
CloudExpo 2014
OARS
DockerCon’16
Goals
Set up an SAP Hybris
ecommerce platform to
scale to 2 million users a
month
Ability to support
Black Friday traffic
Secure for PCI
Compliance
Stateless infrastructure -
HA across all components
including DR
Create an agile developer
workflow for rapid
execution
No downtime
deployment
Performance Scalability Security
High Availability Agility CI/CD
High-Level Diagram
Lambda ECS
Aurora
S3CloudFront WAF
ECR
Private subnetPublic subnet
Storefront
Admin
Aurora
CloudWatch
CloudFormation
CloudTrail
KMS
SES
Route 53S3
bucket
(static
assets)
NAT
gateway
WAF
CloudFront
Lambda
CodeCommit
ACM
Direct Connect
Each subnet represents a pair in two AZs.
All components configured to span two AZs.
Private subnetPublic subnet
Storefront
Admin
Aurora
CloudWatch
CloudFormation
CloudTrail
KMS
SES
Route 53S3
bucket
(static
assets)
NAT
gateway
WAF
CloudFront
Lambda
CodeCommit
ACM
Direct Connect
Each subnet represents a pair in two AZs.
All components configured to span two AZs.
ECS:
1. App agnostic clusters
2. Hosting Apache, Hybris
storefront, Solr
Private subnetPublic subnet
Storefront
Admin
Aurora
CloudWatch
CloudFormation
CloudTrail
KMS
SES
Route 53S3
bucket
(static
assets)
NAT
gateway
WAF
CloudFront
Lambda
CodeCommit
ACM
Direct Connect
Each subnet represents a pair in two AZs.
All components configured to span two AZs.
Application Auto Scaling:
Developed a method for
scaling ECS containers and
instances using Lambda
Private subnetPublic subnet
Storefront
Admin
Aurora
CloudWatch
CloudFormation
CloudTrail
KMS
SES
Route 53S3
bucket
(static
assets)
NAT
gateway
WAF
CloudFront
Lambda
CodeCommit
ACM
Direct Connect
Each subnet represents a pair in two AZs.
All components configured to span two AZs.
Aurora:
1. High performance
2. Scaling
3. Low management
Private subnetPublic subnet
Storefront
Admin
Aurora
CloudWatch
CloudFormation
CloudTrail
KMS
SES
Route 53S3
bucket
(static
assets)
NAT
gateway
WAF
CloudFront
Lambda
CodeCommit
ACM
Direct Connect
Each subnet represents a pair in two AZs.
All components configured to span two AZs.
AWS WAF and CloudFront:
1. AWS Native
2. Self-configuring WAF
with help of Lambda
SCM
Dev
Build
Code +
Dockerfile
On-
premisesAWS
Update
ECS
ImageECR
ECS
Nodes
Code Deployment
DeployUpdate
ECS Nodes
Key Features
Infrastructure as code Agile and flexible
infrastructure
Automated delivery of
infrastructure, code,
containers, and security rules
Self-healing Automatic scaling PCI-ready
… and in time. Finished before deadline.
More Information:
● Session 8872 [ Deploying Scalable SAP Hybris Clusters using
Docker ] at re:Invent 2016 to learn more
● Presentation video from AWS Chicago Summit on how RAC
started: http://bit.ly/2fhVmdw
● Presentation with Docker: http://bit.ly/2faEwjg
● Blog on Application Auto Scaling for ECS: http://amzn.to/2eGoSLK
Q & A
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Register for a Bootcamp
Get in-depth knowledge and
training from AWS Instructors and
Solutions Architects.
reinvent.awsevents.com/training
#AWSTraining
Get AWS Certified Onsite
Demonstrate your technical
proficiency and receive special
recognition onsite. Register today.
reinvent.awsevents.com/certification
#AWSCertified
Take Hands-on Labs
Practice with AWS in a live
environment. Choose from 100+
lab topics and attend a Spotlight
Lab session.
Free Onsite
Thank you!
Remember to complete
your evaluations!