© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Isaiah Weiner, Sr. Mgr. Solutions Architecture

December 1, 2016

Getting Started with the Hybrid Cloud:

Enterprise Backup and Recovery

ENT211

Why hybrid cloud for backup and restore?

- Simple way to start using the cloud

- Addresses the cost and scale problems of data retention

- Capitalizes on your investments

- Third parties with cloud connectors

- Cloud gateway: local performance with cloud scale

- Takes it to the next level

- Migrate old backups from on-premises ($$$$) to the cloud ($).

- Eliminate tapes, trucks, trucks with tapes. Be green!

Batches and Streams

AWS Direct

ConnectAWS Snowball,

AWS Snowball

Edge, AWS

Snowmobile

3rd-Party

Connectors

Transfer

Acceleration

Storage

GatewayAmazon Kinesis

Firehose

File

Amazon EFS

Block

Amazon EBS (persistent)

Object

Amazon GlacierAmazon S3 Amazon EC2

Instance Store (ephemeral)

Backup and recovery before the cloud

Application

servers

Local disk

Media

server

Tape storage

Data bunker

Backup and recovery to the cloud

Amazon S3

Amazon

GlacierDirect

Connect

Internet

Amazon S3-IA

Application

servers

Cloud gateway

Local disk

Media

server

Cloud gateway

Application

servers

Cloud connector

Local disk

Media server

with cloud

connector

Why is the data moving?

Why is the data moving?

What should I use, and when?

Economics Easy to use Reduce risk Agility, scale

Pay as you go

No upfront investment

No commitment

No risky capacity

planning

Self-service

administration

SDKs for simple

integration

Durable and secure

Avoid risks of physical

media handling

Reduce time to market

Focus on your business,

not your infrastructure

Amazon S3

Durable object storage

for all types of data

Amazon EBS

Block storage for use

with Amazon EC2

Amazon Glacier

Archival storage

for infrequently

accessed data

Amazon EFS

File storage for use

with Amazon EC2

AWS Storage Gateway hybrid storage solutionsEnables using standard storage protocols to access AWS storage services

Customer Premises

Storage

Gateway

Amazon EBS

snapshots

Amazon

S3

Amazon Glacier

AWS Identity and

Access Management

(IAM)

AWS KMS

AWS

CloudTrail

Amazon

CloudWatch

Enterprise

storage

Devices

Application

servers

File GatewayOn-premises file storage maintained as objects in Amazon S3

Customer Premises

File

Gateway

Data stored and retrieved from your S3 buckets

One-to-one mapping from files-to-objects

File metadata stored in object metadata

Bucket access managed by IAM role that you own and manage

Use S3 Lifecycle Policies, versioning, or CRR to manage data

Amazon

Glacier

S3

Standard

S3

Standard

–

Infrequent

Access

HTTPSNFS

v3 / v4.1

Application

Server

NFS AWS Storage

Gateway VM

TA

RG

ET

Client

Users

NF

S

CL

IEN

T

Application

servers

NF

S

CL

IEN

T

NFS

Amazon S3

Customer data center

HTTPS

File Gateway Architecture

Application

servers

S3

CL

IEN

T

S3

CL

IEN

T

Application

Server

Volume GatewayOn-premises volume storage backed by Amazon S3 with EBS snapshots

Block storage in S3 accessed via the volume gateway

Compression of data in transit and at rest

Backup on-premises volumes to EBS snapshots

Create on-premises volumes from EBS snapshots

Up to 1 PB of total volume storage per gateway

Amazon

EBS

snapshots

Storage Gateway

bucket in

Amazon S3

Customer Premises

Volume

Gateway

iSCSI HTTPS

iSCSI AWS Storage

Gateway VM

TA

RG

ET

Client

Users

INIT

IAT

OR

Application

servers

INIT

IAT

OR

iSCSI

Amazon EBS

snapshotsAWS

Storage

Gateway service

Customer data center

HTTPS

Volume

storage backed

by Amazon S3

Volume Gateway Architecture

Tape GatewayVirtual tape storage in Amazon S3 and Glacier with VTL management

Virtual tape storage in S3 and Glacier accessed via tape gateway

Compression of data in transit and at rest

Up to 1 PB total tape storage per gateway, unlimited archive capacity

Supports leading backup applications:

Archived tapes

stored in

Amazon Glacier

ME

DIA

CH

AN

GE

R

TA

PE

DR

IVE

Customer Premises

Tape

Gateway

Virtual tapes

stored in

Amazon S3

Backup

Server

HTTPSiSCSI

AWS Storage

Gateway VMME

DIA

CH

AN

GE

R

Backup

Server

INIT

IAT

OR

Virtual tape

shelf backed by

Amazon Glacier

AWS

Storage

Gateway service

Customer data center

HTTPS

Gateway-VTL

storage backed

by Amazon S3

TA

PE

DR

IVE

VTS

Virtual Tape Library Architecture

Cloud gateway: NetApp AltaVault

Common backup applications integrated with AltaVault:Solve backup and archive headaches with cloud-integrated

storage:

90% reduction in time, cost, and data volumes

Shrink recovery times from days to minutes

85% of backup and software providers supported

On Premises

Cloud-integrated storage appliance

NetApp AltaVault

FAS

E-Series

Non-NetApp

storage

Seamlessly integrates into existing storage and backup

software environment

Deduplicates, compresses, and encrypts

Caches recent backups locally, vaults older copies to

the cloud

NetApp SnapProtect

Arcserve

Commvault Simpana

EMC NetWorker

HP Data Protector

IBM Tivoli Storage Manager

Symantec Backup Exec

Symantec (Veritas) NetBackup

Veeam

Microsoft SQL Server

Oracle RMAN

AltaVault also available on Marketplace to protect cloud-native workloads

Store data in the public or private cloud of choice

Amazon S3

Amazon Glacier

Amazon S3-IA

Backup agent

Users

Ma

ste

r

se

rve

r

Me

dia

Ag

en

t

Amazon S3

Customer data center

AWS-ENABLED COMMCELL ARCHITECTURE

Cloud connectors: Commvault Simpana

Me

dia

Ag

en

t

Cloud

storage

library

Amazon Glacier

Backup agent

Users

Ma

ste

r

se

rve

r

Me

dia

se

rve

r

Amazon S3

Customer data center

AWS-ENABLED NETBACKUP ARCHITECTURE

Cloud connectors: Veritas NetBackup

Me

dia

se

rve

r

Cloud

storage

disk pool

Backup agent

Users

Ma

ste

r

se

rve

r

Me

dia

se

rve

r

Amazon S3

Customer data center

AWS-ENABLED NETBACKUP ARCHITECTURE + AMAZON GLACIER SUPPORT

Cloud connectors: NetBackup + StorReduce

Me

dia

se

rve

r

Cloud

storage

disk pool

Amazon Glacier

StorReduce

cluster

Me

dia

Ag

en

t

Amazon S3

Customer VPC

AWS-ENABLED COMMCELL ARCHITECTURE IN EC2

Cloud connectors: Commvault Simpana

Me

dia

Ag

en

t

Cloud

storage

library

Amazon Glacier

EC

2

insta

nce

EC

2

insta

nce

Ma

ste

r

se

rve

r

Me

dia

se

rve

r

Amazon S3

Customer VPC

AWS-ENABLED NETBACKUP ARCHITECTURE IN EC2

Cloud connectors: Veritas NetBackup

Me

dia

se

rve

r

Cloud

storage

disk pool

EC

2

insta

nce

EC

2

insta

nce

Ma

ste

r

se

rve

r

Me

dia

se

rve

r

Amazon S3

Customer VPC

AWS-ENABLED NETBACKUP ARCHITECTURE IN EC2

Cloud connectors: Veritas NetBackup

Me

dia

se

rve

r

Cloud

storage

disk pool

Amazon Glacier

EC

2

insta

nce

EC

2

insta

nce

Ma

ste

r

se

rve

r

StorReduce

cluster

Backup agent

Users

Ma

ste

r

se

rve

r

Me

dia

se

rve

r

Amazon S3

Customer data center

AWS-ENABLED NETBACKUP ARCHITECTURE

Cloud connectors: restore options

Me

dia

se

rve

r

Cloudconnector

Me

dia

se

rve

r

Cloudconnector

Re

sto

red

EC

2

insta

nce

Active archive

What is AWS Snowball? Petabyte-scale data transport

E Ink shipping

label

Ruggedized case

“8.5G impact”

All data encrypted

end-to-end

Rain- and dust-

resistant

Tamper-resistant

case and

electronics

80 TB

10GE network

How it works

How fast is AWS Snowball?

Less than 2 days to fill 5 Snowballs, 400 TB each, in parallel. Back to

AWS in less than 1 week, including shipping.

Number of days to transfer 400 TB via the Internet at typical utilizations:

Internet Connection Speed

Utilization 1 Gbps 500 Mbps 300 Mbps 150 Mbps

25% 152 304 505 1011

50% 74 152 252 505

75% 51 100 168 337

When to use AWS Snowball

Cloud migration

Disaster recovery

Data centerdecommission

Contentdistribution

S3 Transfer Acceleration: up to 300% faster, one click

Automatically changes the DNS name for the bucket (Amazon Route 53)

Bucket traffic moves to Amazon’s CDN network (Amazon CloudFront)

1 2

AWS Snowball S3 Transfer Acceleration

When to use AWS Snowball vs. S3 Transfer Acceleration

Supports import and export

Currently in US West (Oregon),

US East (N. Virginia)

Coming to US West (N.

California), GovCloud (US), Asia

Pacific (Sydney), and EU

(Ireland) regions; expected by

end of 2016

Supports large data transfers,

from TBs to PBs

Supports accelerating transfers

into and out of S3, using AWS

edge locations:

Checkbox WAN acceleration

Up to 6 times faster than regular

networks

Faster or free!

55 AWS edge locations globally

Use Amazon Glacierfor lowest-cost, durable cold

storage of archival data

Use Amazon S3for reliable, durable

primary storage

Use Amazon S3

Infrequent Access

Storage for secondary backups

at a lower cost

S3-IA

Tiering on AWS: optimize your storage spend

Key prefix “logs/”

Transition objects to Amazon Glacier 30 days after creation

Delete 365 days after creation date

<LifecycleConfiguration>

<Rule>

<ID>archive-in-30-days</ID>

<Prefix>logs/</Prefix>

<Status>Enabled</Status>

<Transition>

<Days>30</Days>

<StorageClass>GLACIER</StorageClass>

</Transition>

<Expiration>

<Days>365</Days>

</Expiration>

</Rule>

</LifecycleConfiguration

S3 lifecycle policies

Related Sessions

STG213: Hybrid Cloud Storage Made Simple: The New

Storage Gateway File Interface and Customer Use Cases

PTS401: Using S3 Storage to Reduce Backup Costs on

AWS

STG209: Strategic Planning for Long-Term Data Archiving

with Amazon Glacier

Thank you!

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Who: Lead Software Development Engineers, Architects, and Technical PMs

Where: Storage Booth Walk-up Bar

When: Exhibit hours (Tues 5-7 PM, Wed & Thurs 10:30 AM-6:00 PM)

What: Architecture best practices, code reviews, feature requests

Storage “Office Hours”Meet the People Who Build AWS Storage

Remember to complete

your evaluations!