journey through the aws cloud; cost optimisation
DESCRIPTION
Listen to the webinar recording: http://youtu.be/XLrDxRiLg70 This is the final in our series of webinars, 'Journey Through the AWS Cloud'. This webinar discusses strategies to help you save money in the AWS Cloud. From turning systems off at night, to implementing bidding strategies on the spot market, there are many ways in which you can manage costs in AWS. This webinar will dive into the differences between instance types, explain the intricacies of Reserved Instances, the spot market and architecting to reduce costs. It discusses how to combine on-demand pricing with spot pricing to perform cost effective big data analysis, and introduce customer examples to illustrate how AWS customers gain the most from AWS whilst at the same time managing their spend.TRANSCRIPT
![Page 1: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/1.jpg)
Journey through the Cloud:
Cost optimization
Ryan Shuttleworth – Technical Evangelist @ryanAWS
![Page 2: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/2.jpg)
Common use cases & stepping stones into the AWS cloud Learning from customer journeys
Best practices to bootstrap your projects
Journey through the cloud
![Page 3: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/3.jpg)
A key step in the cloud journey Realize cost aware architectures
Use elasticity to real and measurable benefit Do more, use less
Cost Optimization
![Page 4: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/4.jpg)
Fundamentals of AWS cost optimization Cost optimization in 5 steps Where to go next
Agenda
![Page 5: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/5.jpg)
Fundamentals of cost optimization
![Page 6: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/6.jpg)
Why optimize?
![Page 7: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/7.jpg)
Why optimize?
Utility Compute and Storage are a utility so ‘turning off’ should be natural
![Page 8: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/8.jpg)
Why optimize?
Utility Compute and Storage are a utility so ‘turning off’ should be natural
Efficiency Efficiency allows more to be done
within a given budget
![Page 9: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/9.jpg)
Why optimize?
Utility Compute and Storage are a utility so ‘turning off’ should be natural
Efficiency Efficiency allows more to be done
within a given budget
Architecture Cost awareness drives
adoption of 21st century architectures
![Page 10: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/10.jpg)
Turn off the lights
When you stop EC2 resources you stop paying for them
![Page 11: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/11.jpg)
Be elastic
Support workloads with the right amount of horsepower to get the job
done
![Page 12: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/12.jpg)
Continually optimize
Drive recurring and improving savings through cost aware architectures
![Page 13: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/13.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 14: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/14.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 15: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/15.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
![Page 16: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/16.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
![Page 17: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/17.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
Traditional capacity required
![Page 18: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/18.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
Traditional capacity required
1 Server for 8 hours
![Page 19: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/19.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
Traditional capacity required
1 Server for 8 hours 1 Server for 8 hours
![Page 20: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/20.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
Traditional capacity required
1 Server for 8 hours 1 Server for 8 hours
1 Server for 8 hours
![Page 21: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/21.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
Traditional capacity required
1 Server for 8 hours 1 Server for 8 hours
1 Server for 8 hours
1 Server for 8 hours
![Page 22: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/22.jpg)
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Serv
er
Load
Hour of day
Capacity of 1 Server
Traditional capacity required
1/3rd Saving
![Page 23: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/23.jpg)
2 am
Elastic Capacity
![Page 24: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/24.jpg)
8 am
Elastic Capacity
![Page 25: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/25.jpg)
12 am
Elastic Capacity
![Page 26: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/26.jpg)
4 pm
Elastic Capacity
![Page 27: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/27.jpg)
10 pm
Elastic Capacity
![Page 28: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/28.jpg)
Time: +00h
<10 cores
Elastic Capacity
![Page 29: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/29.jpg)
Time: +24h
>1500 cores
Elastic Capacity
![Page 30: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/30.jpg)
Time: +72h
<10 cores
Elastic Capacity
![Page 31: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/31.jpg)
Time: +120h
>600 cores
Elastic Capacity
![Page 32: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/32.jpg)
Manually
Send an API call or use CLI to launch/terminate instances – Only need to specify capacity
change (+/-)
By Schedule
Scale up/down based on date and time
By Policy
Scale in response to changing conditions, based on user
configured real-time monitoring and alerts
Auto-Rebalance
Instances are automatically launched/terminated to ensure the application is
balanced across multiple Azs
Auto-scaling policies
![Page 33: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/33.jpg)
Auto-scaling policies
Scaling base on Policy
Scale up and down base on metrics
Scaling Up policy - Double the group size if avg cpu > 80%
Scaling Down policy - Decrement by 10% if avg cpu < 30%
Scaling by Schedule
Scheduled Actions to meet known demand
Scheduled up to 31 days into the future
Recurring scheduled scaling activities
![Page 34: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/34.jpg)
0
1
2
3
4
5
6
0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627282930
Inst
ance
Co
un
t
Day of Month
![Page 35: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/35.jpg)
0
1
2
3
4
5
6
0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627282930
Inst
ance
Co
un
t
Day of Month
Monthly predictable
peak processing
![Page 36: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/36.jpg)
0
1
2
3
4
5
6
0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627282930
Inst
ance
Co
un
t
Day of Month
Traditional capacity required
![Page 37: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/37.jpg)
0
1
2
3
4
5
6
0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627282930
Inst
ance
Co
un
t
Day of Month
Elastic Capacity
Traditional capacity required
![Page 38: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/38.jpg)
0
1
2
3
4
5
6
0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627282930
Inst
ance
Co
un
t
Day of Month
75 % Savings
Traditional capacity required
Elastic Capacity
![Page 39: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/39.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 40: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/40.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 41: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/41.jpg)
Instance types
![Page 42: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/42.jpg)
Start
Choose instance that meets your basic
requirements best
Match memory & virtual cores
Instance types
![Page 43: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/43.jpg)
Start
Choose instance that meets your basic
requirements best
Match memory & virtual cores
Tune
Change instance size up or down based upon
monitoring
Use trusted advisor to assess
Instance types
![Page 44: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/44.jpg)
Start
Choose instance that meets your basic
requirements best
Match memory & virtual cores
Tune
Change instance size up or down based upon
monitoring
Use trusted advisor to assess
Spread
Run instances across multiple availability
zones
Smaller sizes equals greater granularity
Instance types
![Page 45: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/45.jpg)
Instance Amazon
CloudWatch Alarm
Free Memory
Free CPU Free HDD
… Custom Metrics
… At 1-min intervals
PUT 2 weeks
Know your usage
![Page 46: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/46.jpg)
Choose your metric optimize for the metric
![Page 47: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/47.jpg)
Choose your metric optimize for the metric
Cost per unit of work per instance(size)
Workload A
Optimal on 4x m1.xlarge
Workload B
Optimal on 10x m1.medium
Workload C
Optimal on 2x m3.xxlarge
![Page 48: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/48.jpg)
Choose your metric optimize for the metric
Cost per unit of work per instance(size)
100 concurrent jobs on 10 x m1.large @ $0.26 / hr = $ 0.026 / job
300 concurrent jobs on 10 x m3.xlarge @ $0.58 / hr = $ 0.019 / job
vs
![Page 49: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/49.jpg)
Choose your metric optimize for the metric
Think workload density Don’t focus on instance hourly rate per se
![Page 52: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/52.jpg)
Division B [email protected]
User2 Dev2 Admin2
IAM
Tags: Own=Div Proj=P
Tags: Own=Div Proj=Q
Tags: Own=Div Proj=R
Master Account
consolidated billing information Tags: (key-value)
e.g Own=Div Proj=R
![Page 53: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/53.jpg)
Operating Co. A [email protected]
User1 Dev1 Admin1
IAM
Tags: Own=OpCo Proj=A
Tags: Own=OpCo Proj=B
Tags: Own=OpCo Proj=C
Division B [email protected]
User2 Dev2 Admin2
IAM
Tags: Own=Div Proj=P
Tags: Own=Div Proj=Q
Tags: Own=Div Proj=R
Business Unit C [email protected]
User3 Dev3 Admin3
IAM
Tags: Own=BusC Proj=X
Tags: Own=BusC Proj=Y
Tags: Own=BusC Proj=Z
Master Account
consolidated billing information
![Page 54: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/54.jpg)
Operating Co. A [email protected]
User1 Dev1 Admin1
IAM
Tags: Own=OpCo Proj=A
Tags: Own=OpCo Proj=B
Tags: Own=OpCo Proj=C
Division B [email protected]
User2 Dev2 Admin2
IAM
Tags: Own=Div Proj=P
Tags: Own=Div Proj=Q
Tags: Own=Div Proj=R
Business Unit C [email protected]
User3 Dev3 Admin3
IAM
Tags: Own=BusC Proj=X
Tags: Own=BusC Proj=Y
Tags: Own=BusC Proj=Z
Master Account
consolidated billing information
![Page 55: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/55.jpg)
Operating Co. A [email protected]
User1 Dev1 Admin1
IAM
Tags: Own=OpCo Proj=A
Tags: Own=OpCo Proj=B
Tags: Own=OpCo Proj=C
Division B [email protected]
User2 Dev2 Admin2
IAM
Tags: Own=Div Proj=P
Tags: Own=Div Proj=Q
Tags: Own=Div Proj=R
Business Unit C [email protected]
User3 Dev3 Admin3
IAM
Tags: Own=BusC Proj=X
Tags: Own=BusC Proj=Y
Tags: Own=BusC Proj=Z
Master Account
consolidated billing information
Programmatic billing access
S3 CSV
![Page 56: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/56.jpg)
Operating Co. A [email protected]
User1 Dev1 Admin1
IAM
Tags: Own=OpCo Proj=A
Tags: Own=OpCo Proj=B
Tags: Own=OpCo Proj=C
Division B [email protected]
User2 Dev2 Admin2
IAM
Tags: Own=Div Proj=P
Tags: Own=Div Proj=Q
Tags: Own=Div Proj=R
Business Unit C [email protected]
User3 Dev3 Admin3
IAM
Tags: Own=BusC Proj=X
Tags: Own=BusC Proj=Y
Tags: Own=BusC Proj=Z
Master Account
consolidated billing information
Programmatic billing access
S3 CSV
![Page 57: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/57.jpg)
Business
Basic
Developer
Enterprise
Offering
24x7x365 ✓
Forum Access ✓
Documentation ✓
Access to support Phone, Chat,
Named Contacts 5
Fastest Response Time 1 Hour
Architecture Support Use Case
Guidance
Best Practice ✓
Diagnostics Tools ✓
Direct Routing ✓
3rd Party Software ✓
Trusted Advisor ✓
![Page 58: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/58.jpg)
![Page 59: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/59.jpg)
![Page 60: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/60.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 61: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/61.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 62: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/62.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
Reserved instances
![Page 63: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/63.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
1- or 3-year terms
Pay low up-front fee, receive significant hourly discount
Low Cost / Predictability
Helps ensure compute capacity is available
when needed
Use Cases:
Applications with steady state or predictable usage
Applications that require reserved capacity,
including disaster recovery
Reserved instances
Reserved instances
![Page 64: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/64.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
1- or 3-year terms
Pay low up-front fee, receive significant hourly discount
Low Cost / Predictability
Helps ensure compute capacity is available
when needed
Use Cases:
Applications with steady state or predictable usage
Applications that require reserved capacity,
including disaster recovery
Reserved instances
Reserved instances
> 80% utilization Lower costs up to 58%
Use Cases: Databases, Large Scale HPC, Always-on infrastructure, Baseline
Heavy utilization RI
![Page 65: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/65.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
1- or 3-year terms
Pay low up-front fee, receive significant hourly discount
Low Cost / Predictability
Helps ensure compute capacity is available
when needed
Use Cases:
Applications with steady state or predictable usage
Applications that require reserved capacity,
including disaster recovery
Reserved instances
Reserved instances
> 80% utilization Lower costs up to 58%
Use Cases: Databases, Large Scale HPC, Always-on infrastructure, Baseline
Heavy utilization RI
41-79% utilization Lower costs up to 49%
Use Cases: Web applications, many heavy processing tasks, running much of the time
Medium utilization RI
![Page 66: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/66.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
1- or 3-year terms
Pay low up-front fee, receive significant hourly discount
Low Cost / Predictability
Helps ensure compute capacity is available
when needed
Use Cases:
Applications with steady state or predictable usage
Applications that require reserved capacity,
including disaster recovery
Reserved instances
Reserved instances
> 80% utilization Lower costs up to 58%
Use Cases: Databases, Large Scale HPC, Always-on infrastructure, Baseline
Heavy utilization RI
41-79% utilization Lower costs up to 49%
Use Cases: Web applications, many heavy processing tasks, running much of the time
Medium utilization RI
15-40% utilization Lower costs up to 34%
Use Cases: Disaster Recovery, Weekly / Monthly reporting, Elastic Map Reduce
Light utilization RI
![Page 67: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/67.jpg)
Best RI for Utilisation
$-
$2,000
$4,000
$6,000
$8,000
$10,000
$12,000
$14,000
$16,000
$18,000
Heavy
Medium
Light
O-Demand
![Page 68: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/68.jpg)
Best RI for Utilisation
$-
$2,000
$4,000
$6,000
$8,000
$10,000
$12,000
$14,000
$16,000
$18,000
Heavy
Medium
Light
O-Demand
![Page 69: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/69.jpg)
0
2
4
6
8
10
12
14
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
On Demand
Light Utilization RI
Medium Utilization RI
Heavy utilization RI
Optimizing costs with RIs
![Page 70: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/70.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 71: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/71.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 72: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/72.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
1- or 3-year terms
Pay low up-front fee, receive significant hourly discount
Low Cost / Predictability
Helps ensure compute capacity is available
when needed
Use Cases:
Applications with steady state or predictable usage
Applications that require reserved capacity,
including disaster recovery
Reserved instances
Spot instances
![Page 73: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/73.jpg)
Unix/Linux instances start at $0.02/hour
Pay as you go for compute power
Low cost and flexibility
Pay only for what you use, no up-front commitments or long-term contracts
Use Cases:
Applications with short term, spiky, or
unpredictable workloads;
Application development or testing
On-demand instances
1- or 3-year terms
Pay low up-front fee, receive significant hourly discount
Low Cost / Predictability
Helps ensure compute capacity is available
when needed
Use Cases:
Applications with steady state or predictable usage
Applications that require reserved capacity,
including disaster recovery
Reserved instances
Bid on unused EC2 capacity
Spot Price based on supply/demand, determined automatically
Cost / Large Scale, dynamic workload handling
Use Cases:
Applications with flexible start and end times
Applications only feasible at very low compute prices
Spot instances
Spot instances
![Page 74: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/74.jpg)
100%
Achieving economies of scale
Time
![Page 75: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/75.jpg)
Reserved capacity
100%
Achieving economies of scale
Time
![Page 76: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/76.jpg)
On
Reserved capacity
100%
On-demand
Time
Achieving economies of scale
![Page 77: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/77.jpg)
On
Reserved capacity
100%
On-demand
Time
Achieving economies of scale
Spot
![Page 78: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/78.jpg)
![Page 79: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/79.jpg)
![Page 80: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/80.jpg)
If your bid > spot price You get an instance
![Page 81: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/81.jpg)
If your bid < spot price Your instance is terminated
![Page 82: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/82.jpg)
Architecting for spot instances
Decouple components
Separate interactive & backend processing
Use frameworks such as Elastic MapReduce
Design for interruption
Use SQS, SWF
Place data in a durable store such as S3, SimpleDB or DynamoDB
Save progress regularly
![Page 83: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/83.jpg)
Job Flow
14 Hours
Duration:
Scenario #1
EMR with spot instances
#1: Cost without Spot 4 instances *14 hrs * $0.50 = $28
![Page 84: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/84.jpg)
Job Flow
14 Hours
Duration:
Scenario #1
Duration:
Job Flow
7 Hours
Scenario #2
EMR with spot instances
#1: Cost without Spot 4 instances *14 hrs * $0.50 = $28
![Page 85: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/85.jpg)
Job Flow
14 Hours
Duration:
Scenario #1
Duration:
Job Flow
7 Hours
Scenario #2
EMR with spot instances
#1: Cost without Spot 4 instances *14 hrs * $0.50 = $28
#2: Cost with Spot 4 instances *7 hrs * $0.50 = $14 + 5 instances * 7 hrs * $0.25 = $8.75
Total = $22.75
![Page 86: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/86.jpg)
Job Flow
14 Hours
Duration:
Scenario #1
Duration:
Job Flow
7 Hours
Scenario #2
EMR with spot instances
#1: Cost without Spot 4 instances *14 hrs * $0.50 = $28
#2: Cost with Spot 4 instances *7 hrs * $0.50 = $14 + 5 instances * 7 hrs * $0.25 = $8.75
Total = $22.75
Time Savings: 50% Cost Savings: ~22%
![Page 87: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/87.jpg)
Spot market Bidding strategies
![Page 88: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/88.jpg)
0%
2%
4%
6%
8%
10%
12%
14%
16%
18%
20%
Perc
enta
ge o
f th
e D
istr
ibu
tio
n
Bid Price as Percentage of the On-Demand Price
Bid Distribution (for 3 months period)
Spot bidding strategies
![Page 89: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/89.jpg)
0%
2%
4%
6%
8%
10%
12%
14%
16%
18%
20%
Perc
enta
ge o
f th
e D
istr
ibu
tio
n
Bid Price as Percentage of the On-Demand Price
Bid Distribution (for 3 months period)
Spot bidding strategies
Bid near the RI hourly price
![Page 90: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/90.jpg)
0%
2%
4%
6%
8%
10%
12%
14%
16%
18%
20%
Perc
enta
ge o
f th
e D
istr
ibu
tio
n
Bid Price as Percentage of the On-Demand Price
Bid Distribution (for 3 months period)
Spot bidding strategies
Bid above the spot price history
![Page 91: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/91.jpg)
0%
2%
4%
6%
8%
10%
12%
14%
16%
18%
20%
Perc
enta
ge o
f th
e D
istr
ibu
tio
n
Bid Price as Percentage of the On-Demand Price
Bid Distribution (for 3 months period)
Spot bidding strategies
Bid near the on-demand
price
![Page 92: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/92.jpg)
0%
2%
4%
6%
8%
10%
12%
14%
16%
18%
20%
Perc
enta
ge o
f th
e D
istr
ibu
tio
n
Bid Price as Percentage of the On-Demand Price
Bid Distribution (for 3 months period)
Spot bidding strategies
Bid above the on-demand price
![Page 93: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/93.jpg)
Bid near the reserved hourly price You only pay for a full hour
![Page 94: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/94.jpg)
Bid near the reserved hourly price You only pay for a full hour
(if you are interrupted the hour is free)
![Page 95: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/95.jpg)
Bid above the on-demand price Expect fewer interruptions
![Page 96: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/96.jpg)
Bid above the on-demand price Expect fewer interruptions
(only pay the spot price)
![Page 97: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/97.jpg)
Implement cost aware architecture Flip from spot to on-demand as price dictates
![Page 98: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/98.jpg)
Spot customers
![Page 99: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/99.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 100: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/100.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 101: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/101.jpg)
$0.028 per hour
Web Servers
Availability Zone
Elastic Load
Balancer DNS
![Page 102: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/102.jpg)
Web Servers
$0.085 per hour
(small instance)
Availability Zone
$0.028 per hour
Web Servers
Availability Zone
EC2 instance
+ software LB
Elastic Load
Balancer DNS
DNS
VS
![Page 103: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/103.jpg)
SQS queue
Consumers Producer
$0.01 per
10,000 Requests ($0.000001 per Request)
![Page 104: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/104.jpg)
Producer
SQS queue
Consumers
Consumers Producer
EC2 instance
+ software queue
$0.01 per
10,000 Requests ($0.000001 per Request)
$0.085 per hour
(small instance)
VS
![Page 105: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/105.jpg)
Software vs services
Software on EC2
Pros: Use custom features
Cons:
Requires an instance SPOF
Limited to one AZ DIY administration
AWS Services
ELB, SNS, SQS, SES, SWF, DynamoDB etc
Pros: Pay as you go
Scalability Availability
High performance
![Page 106: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/106.jpg)
Summary
![Page 107: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/107.jpg)
Elastic capacity Instance types Reserved instances Spot instances Complementary services
5 Steps for cost optimization
![Page 108: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/108.jpg)
Where to go next
![Page 109: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/109.jpg)
aws.amazon.com/economics
aws.amazon.com/calculator
Useful links
![Page 110: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/110.jpg)
Useful links
http://aws.amazon.com/whitepapers
![Page 111: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/111.jpg)
![Page 112: Journey Through the AWS Cloud; Cost Optimisation](https://reader033.vdocuments.us/reader033/viewer/2022051611/54b6ecd24a7959664e8b4598/html5/thumbnails/112.jpg)
aws.amazon.com