aws june 2016 webinar series - best practices for architecting cloud backup and recovery solutions
TRANSCRIPT
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
David Potes, AWS Partner Solutions Architecture
6/28/2016
Getting Started with the Hybrid Cloud: Enterprise Backup and
Recovery
Why Hybrid Cloud for Backup & Restore?
Save the day! Simple way to start using the cloud Addresses the cost and scale problems of data retention
Capitalize on your investments 3rd parties with Cloud Connectors Cloud Gateway: local performance with cloud scale
Take it to the next level Migrate old backups from on-prem ($$$$$) to the cloud ($) Eliminate tapes, trucks, trucks with tapes. Be green!
Applicationservers
Local disk
MediaServer
Tape Storage
Data Bunker
Backup and Recovery before the Cloud
Amazon S3
Amazon GlacierAWS
DirectConnect
InternetAmazon S3-IA
Applicationservers
Cloud Gateway
Local disk
MediaServer
Cloud Gateway
HTTPS/API
Applicationservers
Cloud Connector
Local diskMedia
Server with cloud
connector
HTTPS/API
Backup and Recovery to the Cloud
What should I use, and when?
Economics Easy to Use Reduce risk Agility, Scale Pay as you go
No upfront investment
No commitment
No risky capacity planning
Self service administration
SDKs for simple integration
Durable and Secure
Avoid risks of physical media handling
Reduce time to market
Focus on your business, not your infrastructure
Amazon S3Durable object storage
for all types of data
Amazon EBSBlock storage for use
with Amazon EC2
Amazon GlacierArchival storage for infrequently accessed data
Amazon EFSFile storage for use with Amazon EC2
Cloud Gateway: AWS Storage Gateway
Amazon EBS snapshots
Amazon S3
Amazon Glacier
AWSStorage Gateway
appliance
Applicationserver
AWSStorage Gateway
backendAWS
DirectConnect
Internet
Customer premises
GATEWAY-STORED VOLUME ARCHITECTURE
iSCSI
AWS Storage Gateway VM
Upload Buffer
Volume VolumeStorage
TAR
GE
T
Client
Users
INIT
IATO
R
Application Servers
INIT
IATO
R
iSCSI
Amazon EBS snapshots
AWS Storage Gateway Service
Customer Data Center
Cloud Gateway: AWS Storage Gateway
iSCSI
AWS Storage Gateway VM
Upload Buffer
CacheStorage
TAR
GE
T
Client
Users
INIT
IATO
R
Application Servers
INIT
IATO
R
iSCSIAmazon EBS
snapshotsAWS
Storage Gateway Service
Customer Data Center
HTTPS
Volume Storage
backed by Amazon S3
Cloud Gateway: AWS Storage GatewayGATEWAY-CACHED VOLUME ARCHITECTURE
AWS Storage Gateway VM
Upload Buffer
CacheStorage
ME
DIA
C
HA
NG
ER
BackupServer
INIT
IATO
R
Virtual Tape Shelf backed by Amazon Glacier
AWS Storage Gateway Service
Customer Data Center
HTTPS
Gateway-VTL storage backed by Amazon S3
TAP
E
DR
IVE
VTS
Cloud Gateway: AWS Storage GatewayGATEWAY-VIRTUAL TAPE LIBRARY ARCHITECTURE
Cloud Gateway: NetApp AltaVault
Common backup applications integrated with AltaVaultSolve backup & archive headaches with cloud-integrated storage
90% reduction in time, cost, and data volumes Shrink recovery times from days to minutes 85% of backup & software providers supported
On Premises
Cloud-integrated storage appliance
NetApp AltaVault
FAS
E-SeriesNon-NetApp
Storage
Seamlessly integrates into existing storage and backup
software environment
Deduplicates, compresses, and encrypts
Caches recent backups locally, vaults older copies to
the cloud
NetApp SnapProtect Arcserve CommVault Simpana EMC NetWorker HP Data Protector IBM Tivoli
Storage Manager
Symantec Backup Exec
Symantec (Veritas) NetBackup
Veeam Microsoft SQL
Server Oracle RMAN
Store data in the public or private cloud of choice
Amazon S3
Amazon Glacier
Amazon S3-IA
AltaVault also available on marketplace to protect cloud-native workloads
Cloud Connectors: CommVault Simpana
Backup Agent
Users
Mas
ter
Ser
ver
Med
iaA
gent
Amazon S3
Customer Data Center
Med
iaA
gent
Cloud Storage Library
AWS ENABLED COMMCELL ARCHITECTURE
Backup Agent
Users
Mas
ter
Ser
ver
Med
iaA
gent
Amazon S3
Customer Data Center
Cloud Connectors: CommVault Simpana
Med
iaA
gent
Cloud Storage Library
Amazon Glacier
AWS ENABLED COMMCELL ARCHITECTURE
Backup Agent
Users
Mas
ter
Ser
ver
Med
ia
Ser
ver
Amazon S3
Customer Data Center
Cloud Connectors: Veritas NetBackup
Med
ia
Ser
ver
Cloud Storage
Disk Pool
AWS ENABLED NETBACKUP ARCHITECTURE
Active Archive
All data encrypted end-to-end
Rain & dust resistant
Tamper-resistant case & electronics
E-ink shipping label
Ruggedizedcase “8.5G Impact”
80 TB 10GE network
What is Snowball? Petabyte scale data transport
How it works
Less than 1 day to transfer 250TB via 5x10G connections with 5 Snowballs, less than 1 week including shipping
Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection SpeedUtilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211
How fast is Snowball?
Cloud Migration
Disaster Recovery
DatacenterDecommission
ContentDistribution
When to use AWS Import/Export Snowball
S3-XA: up to 300% faster with one click
Automatically changes the DNS name for the bucket (route53)Bucket traffic moves to Amazon’s CDN network (CloudFront)
1 2
AWS Snowball
AWS S3-XA
When to use Snowball vs S3-XA?
Supports import and export Currently in US West (Oregon), US East (N. Virginia) Coming to US West (N. California), GovCloud (US), Asia Pacific (Sydney), and EU
(Ireland) regions expected by end of 2016 Supports large data transfers, from TBs to PBs
Supports accelerating transfers into and out of S3, using AWS Edge Locations: Checkbox WAN acceleration Up to 6 times faster than regular networks Faster or free! 55 AWS Edge Locations Globally
Use Amazon Glacierfor lowest-cost, durable cold
storage of archival data
Use Amazon S3 for reliable,
durable primary storage
Use Amazon S3 Infrequent Access
Storage for secondary backups
at a lower cost
S3-IA
Tiering on AWS: optimize your storage spend
Key prefix “logs/” Transition objects to Glacier 30 days after creation Delete 365 days after creation date
<LifecycleConfiguration> <Rule>
<ID>archive-in-30-days</ID> <Prefix>logs/</Prefix> <Status>Enabled</Status> <Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass> </Transition> <Expiration>
<Days>365</Days> </Expiration>
</Rule></LifecycleConfiguration
S3 lifecycle policies
What about WORM?
SEC Rule 17a-4(f) FINRA Rule 4511 CFTC Regulation 1.31
Data Storage for the Long Haul: Compliance and Archive
Room E3523:30PM-4:30PM
Remember to complete your evaluations!