aws summit berlin 2013 - choosing the right data storage options with aws
TRANSCRIPT
James Brown, Business Development Manager
Choosing the right data storage options with AWS
Object Storage
Block Storage
Connecting AWS Storage to On-premise
What are we going to cover?
#1Object Storage
●○○
Amazon S3Simple Storage Service
99.999999999%Durability
Over 2 TrillionUnique Customer Objects
Over 1.1 millionPeak Transactions Per Second
Spotify adds over 20,000 tracks a
day.
“Amazon S3 gives us confidence in
our ability to expand storage
quickly while also providing high data durability.”
Emil Fredriksson, operations director
Case S
tudy
Amazon S3Store objects from 1 byte to 5 terabytes
Uses standards based REST and SOAP protocols
Highly durable, fully managed
Designed to make web-scale computing easier
Amazon S3 - Unlimited Storage
Amazon S3 WebsitesEasily handle peak loads at low cost
Pay as you go pricing
Inexpensive and Highly Scalable web hosting
Static Website Hosting
Real Clear Politics served up
to 20x normal demand with S3
Websites
Case S
tudy
CloudFrontPay as you go pricing with no long term
commitments
Caches content closer to your users to
lower latency and better performance
Integrated low latency content distribution network
Deliver content with lower latency with CloudFront
Storage costs as low as 5½ cents per GB
USE AMAZON S3WHEN YOU NEED:
High Durability
Unlimited Storage Capacity
High Scale
High Volume Static Websites
Delivery via CloudFront
Amazon GlacierLow-Cost Archiving Service
1¢Per GB / Month
$125Per TB / Year
99.999999999%Durability
3-5 HoursData Retrieval
Storage Costsvs
Retrieval Costs
Lifecycle PoliciesCreate rules on object prefix
Create rules to also delete expired object
Automatically tier S3 data in Glacier
Using Lifecycle policies to move data
Riverbed WhitewaterEliminates the burden of tape
Improve DR
Additional layer of security
Reduce storage requirements by 10 to 30x
A physical device can manage integration with Glacier
3rd Party Solution integration with Glacier
Their use of S3, Glacier and
CloudFront gives them more time to
concentrate on their business,
rather than worrying about the hardware
#2Block Storage
○●○
Amazon EBSElastic Block Store
Ephemeral storage is on every EC2 instance
Amazon EBSParticularly suited for applications that require
a database, file system, or access to raw block
level storage.
Can be attached to a running instance
Network attached persistent block level storage volumes
EBS Drives can be moved between instances
How do our customers use EBS?
Enterprises
Enterprise workloads are built
on block storageOracle, SAP,
Microsoft
Gaming customers
Very high performance
databases.500,000 IOPS for a new game launch
Social Network /
Mobile Apps
Very high performance and consistent I/O for
NoSQL and relational DBs
Marketing / Analytics
High performance I/O databases
Multiple drives on one Amazon EC2 instance
10GB Ú 1TB
Provisioned IOPSAmazon EBS
Provisioned IOPSP-IOPS is designed to run transactional
applications that require high and
consistent I/O
Workloads on Provisioned IOPs
Use Cases
Relational Databases
NoSQL Databases (eg MongoDB)
High Performance File Systems
Enterprise Workloads (eg CRM, MS Exchange, ERP)
Provisioned IOPS- For steady I/O use Provisioned IOPS
- For bursty I/O, run the numbers
Optimized for price/performance
EBS SnapshotsAmazon EBS
EBS Snapshots- Snapshots from EBS are stored in Amazon
S3- Rollback to a previous version- Can be copied between regions
EBS Snapshots – Stored in Amazon S3
USE AMAZON EBSWHEN YOU NEED:
Filesystem for an instanceNTFS, ExtFS, RAID, LVM…
Long-term persistent storage
Data changes frequently
Access to raw, unformatted block-level storage
#3Connecting AWS Storage to On-
Premise Environments○○●
AWS Storage GatewayConnecting with on-premise
AWS Storage Gateway- Low latency access to frequently accessed data- Minimise the need to scale out on-premise
storage- Snapshots allow access to old data
Up to 150TBs supported from a single Storage Gateway
Extend your on-premise storage
USE AWS STORAGE GATEWAYWHEN YOU NEED:
Synchronize data for disaster recovery
Departmental fileshare
Backup your data
Oracle Secure Backup Module
Oracle Secure Backup (OSB) Cloud
Module allows customers to backup
Oracle Databases directly to Amazon S3
using the Oracle Recovery Manager
(RMAN)
Backup Oracle into Amazon S3
Restore times reduced from 15
to 2½ hours
Took less that 1 hour to configure
per database
Offered significant improvements in
durability of backups
Case S
tudy
IT’S ALL ABOUT
CHOICEPERFORMANCE-ORIENTED
COST-ORIENTED
Thank You