(spot211) state of the union: amazon compute services | aws re:invent 2014
DESCRIPTION
Join Peter De Santis, Vice President of Amazon Compute Services, and Matt Garman, Vice President of Amazon EC2 as they share a ''behind the scenes'' look at the evolution of compute at AWS. You hear about the drivers behind the innovations we've introduced, and learn how we've scaled our compute services to meet dramatic usage growth.TRANSCRIPT
2011 2012 2013 2014
99% YoY increase in EC2 instance usage
(Q3 2014 vs. Q3 2013, not including Amazon use)
do more with less
operational excellence at scale
Do more with less
C4
T2
R3
I2
G2
We use Amazon EC2 to serve hundreds of millions of
Pinterest users. Our C1 to C3 migration of over 1200
app servers took no more than three days while
reducing the EC2 instance footprint by 75%,
and adding 30% more compute capacity.
Such a project could easily take up to 3 months and
some serious project management in a traditional
data center environment.
Raj Patel, Head of Cloud Engineering at Pinterest
”
“
Simulated 22 advanced
head designs, 3 materials
= 1 million possible designs
Used c3 instances with
Intel IvyBridge cores
Ran in 8 hours vs. 30 days
on internal cluster!
Total cost:
$5,593.94
New Drive Head
Design
Workloads
Submit jobs, orchestrate
HPC clusters over VPN
Encrypt, route data to
AWS, return results
HPC Cluster
70k Cores
Of Spot
Instances
Transforming Disk Drive DesignDesigning devices that store the world’s data
•
•
•
•
•
•
Low Utilization
High Utilization
Apache
MySQL
Tomcat
nginx
PostgreSQL
Rails
MongoDBdjango
OpenVPNnodejs
WordPress
Asterisk
IIS
LighttpdPHP
Varnish
Selenium
Subversion
Flask
LAMPhaproxy
R
Git
Jenkins
OpenERP
“Is there no minimum guaranteed level of CPU performance?”
“I could get all of a core or be totally starved?”
“It would be great to get solid lower bound on physical CPU
allocation even if it was indeed low, so we know what to expect.”
General Purpose (SSD) Volumes
SSD-backed • 3 IOPS per GB of baseline performance
• Burst up to 3000 IOPS for 30 minutes
Target use cases • Boot volumes
• Small to medium database
Only 0.3% of volumes run out of burst credits
Performance (per volume)
GP2 PIOPS GP2 PIOPS
Max Size 1 TB 1 TB 16 TB 16 TB
Max IOPS 3,000 4,000 10,000 20,000
Max Throughput 128 MBps 128 MBps 160 MBps 320 MBps
PREVIOUSLYW/ LARGER &
FASTER VOLUMES
Glympse is a fast, free, and simple way to share your location in
real time with the people you trust.
I LOVE the T2 instances. I'm
shocked and surprised at how well
they perform. We saw a 74% cost
savings in moving to them..
Craig Link
Cloud Architect, Glympse
”
“
Instance vCPU Mem
(GiB)
Monthly price
(3-yr heavy RI )
Ideal use case
m3.medium 1 3.75 $20.16 Always available, balanced
c3.large 2 3.75 $29.95 Always available, compute
t2.medium 2 4 $17.87 Bursty workloads
T2
Amazon
CloudWatch
Operational Excellence at Scale
2011 2012 2013 2014
99% YoY increase in EC2 instance usage
(Q3 2014 vs. Q3 2013, not including Amazon use)
90
91
92
93
94
95
96
97
98
99
100
%Success Rate
Please give us your feedback on this session.
Complete session evaluations and earn re:Invent swag.
http://bit.ly/awsevals