the cloudiest storage - snia · benefits of having vendor storage in the cloud •not all...

2019 Storage Developer Conference. © All Rights Reserved. 1

The Cloudiest Storage, The Storagiest CloudAn Independent Study of Hyperscalers' Storage Offerings

Gregory Touretsky


Who is Mr. Touretsky?Because I care


Introducing Infinidat

>5 EB deployed and growing!

Because they pay me


What are we going to talk about?

From the traditional enterprise storage point of view

Block File Object

Agenda


Key takeaway: today’s public cloud storage offerings are not good enough for “lift and shift”

enterprise workloads


Block storage


Basic FunctionalityAWS EBS Azure MD GCP PD IBM BS Oracle BV Alibaba CD

Max size 16 TiB 32 TiB (data)2 TiB (boot)

64 TB 12 TB 32TB Varies by tier, up to 32TiB

Snapshots Copy to S3 Copy to Blob Copy to GCS Yes Copy to object Copy to object

Availability 99.99% 99.999% ?? 99.9% / 99.95% 99.99% ??

Media tiers Yes Yes Yes Yes No Yes

Encryption Yes Yes Yes Yes Yes Yes


Availability in the cloud?


Enterprise FunctionalityAWS Azure GCP IBM Oracle Alibaba

Multi-attach No No Read-only Yes Read-only No

RW Snapshots No No No Clone Clone No

Consistency Gs Yes No No No Yes No

Async Replication

No GRS No Yes No No

Sync replication

No ZRS Regional PD No No No

Multi-path No No No Yes No? No

Thin provisioning

No No No No No No

Compression No No No No No No

On-prem connectivity

No No No No No No


Block storage – single disk latency, ms

0

5

10

15

20

25

30

35

4k random read, ms 4k random write, ms 64k random read, ms 64k random write, ms

AWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, IO1/10k IOPsAWS m4.10xlarge, RHEL7.5 EBS 1 vol 200GB, 25 threads, GP2 600-3000IOPsAzure Disk 1 - PremiumSSD 1023GB 5000 IOPs 200MBps) 25 threadsGCP n1-standard-16, one out of 1 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threadsGCP n1-standard-16, one out of 8 vols- SSD PD - 100GB - 3000 IOPS; 48 MBps; 25 threads


Block storage – single disk, IOPS

0

10000

20000

30000

40000

50000

60000

4k random read, ms 4k random write, ms 64k random read, ms 64k random write, ms



Block storage – single disk, MB/sec

0

100

200

300

400

500

600

4k random read, ms 4k random write, ms 64k random read, ms 64k random write, ms 1M seq read, MB/sec 1M seq wr ite, MB/sec



Price: $/GB/month

0

0.1

0.2

0.3

0.4

0.5

0.6

Top SSD Low SSD Top HDD Low HDD

AWS Azure Google IBM Oracle Alibaba• AWS: IOPS cost is not included for provisioned io volumes• Azure: no Ultra disks included; price calculated based on 1TiB drives• Google: Regional and Zonal storage pricing• IBM: Endurance tiers, media is not clear• Oracle: single tier, media is not clear


Price: 1PB usable over 3 years

$-

$2,000,000

$4,000,000

$6,000,000

$8,000,000

$10,000,000

$12,000,000

$14,000,000

$16,000,000

$18,000,000

$20,000,000

Top SSD Low SSD Top HDD Low HDD

AWS Azure Google IBM Oracle Alibaba• AWS: IOPS cost is not included for provisioned io volumes• Azure: no Ultra disks included; price calculated based on 1TiB drives• Google: Regional and Zonal storage pricing• IBM: Endurance tiers, media is not clear• Oracle: single tier, media is not clear


Notes§ Tiering varies between clouds

§ Usually media-defined (HDD vs SSD)§ Performance per disk / instance is limited

§ depends on max instance throughput, max volume xput, aggregated volumes xput, number of attached drives, storage account, …

§ Availability?§ No replication, multipath, SLAs are low, …

§ Basic functionality is there§ But most of the Enterprise features are not

§ Expensive


File storage


Basic FunctionalityAWS EFS Azure Files GCP

FilestoreIBM FS Oracle FS Alibaba NAS

Max size No limit (8 EB) 5TiB. 100 TiB(preview)

63.9 TB 12 TB No limit (8EB) 10PB

Snapshots No Yes No Yes Yes Yes

Availability 99.9% High (replication)

99.9% ?? ?? 99.9%

Performance tiers

Yes Yes Yes Yes No Yes

Encryption Yes Yes ?? Yes Yes Yes

Protocols NFSv4.1 (part) SMB 3.0 NFSv3 NFS NFSv3 NFSv3/4, SMB2/3


Enterprise FunctionalityAWS Azure GCP IBM Oracle Alibaba

RW Snapshots No No No Clone

Consistency Gs No No No No

Async Replication

No GRS No Yes

Sync replication

Cross-AZ ZRS No No

Thin provisioning

No No No No

Compression No No No No

Quotas No No No No

On-prem connectivity

Yes (*) Yes (*) No No


File storage – single disk latency, ms

4k random read, ms 4k random write, ms 64k random read, ms 64k random write, msm4.10xlarge, RHEL7.5 EFS - GP , 25 threads. 80GB used 4.1 107 15.6 99

Azure FS - GRS 34.2 29.9 57.1 54.5

GCP n1-s tandard-16 us-east1b Google Filestore 2.5TBPremium Tier (R: 30k ops, W:25k ops; R:700MBps,

W:350MBps)0.6 8.2 1.7 10

0.1

1

10

100

1000Log


File storage – single disk, IOPS

4k random read, ms 4k random write, ms 64k random read, ms 64k random write, msm4.10xlarge, RHEL7.5 EFS - GP , 25 threads. 80GB used 6036 234 1597 252

Azure FS - GRS 730 836 438 458


W:350MBps)43063 3041 14942 2492

1

10

100

1000

10000

100000Log


File storage – single disk, MB/sec

4k random read, ms 4k random write,ms

64k random read,ms

64k random write,ms

1M seq read,MB/sec

1M seq wr ite,MB/sec

m4.10xlarge, RHEL7.5 EFS - GP , 25 threads. 80GB used 23 0.915 99 15 100 101

Azure FS - GRS 2 3 27 28 74 32


W:350MBps)168 11 933 155 1072 382

0.1

1

10

100

1000

10000Log


File storage: $/GB/month

0

0.1

0.2

0.3

0.4

0.5

0.6

Standard tier Low cost tier

AWS Azure Google IBM Oracle Alibaba


File storage: 1PB usable over 3 years

$-

$2,000,000

$4,000,000

$6,000,000

$8,000,000

$10,000,000

$12,000,000

$14,000,000

$16,000,000

$18,000,000

$20,000,000

Standard tier Low cost tier



Notes

§ Performance is limited§ depends on max instance throughput, used capacity, storage

account, …§ Basic functionality is there

§ But most of the Enterprise features are not§ Availability?§ Expensive


Object storage


Object storage: $/GB/month

0

0.005

0.01

0.015

0.02

0.025

0.03

Standard tier Low cost


Storage only, doesn’t include requests costs or egress


Object storage: 1PB usable over 3 years

$-

$100,000

$200,000

$300,000

$400,000

$500,000

$600,000

$700,000

$800,000

$900,000

$1,000,000

Standard tier Low cost



Data access vs Data storage costsS3 Standard storage - US East On Sep, 10 2019

Storage cost <50TB $0.023 per GB per monthNext 450TB $0.022 per GB per monthOver 500TB $0.021 per GB per month

PUT, COPY, POST, or LIST Requests $0.005 per 1000 requestsGET, SELECT and all other Requests $0.0004 per 1000 requests

Data transfer from AWS to Internet $0.090 per GB

INPUTSEnvironmnet life time 3 yearsUsed capacity 1,000 TB# of PUT/POST 200 requests / sec# of GET 500 requests / secAmount of data transferred to Internet 0 TBs

Estimated S3 costStorage $775,800.00PUT/POST requests $94,608.00GET requests $18,921.60Egress $0.00Total $889,329.60


Notes

§ Object storage is THE cloud storage§ Still have a limited adoption on-prem§ There is no “Enterprise” feature-set for

object§ Not cheap


Summary


Actual Enterprise customer’s noteBenefits of having VENDOR storage in the CLOUD

•Not all applications can be rewritten to consume services in CLOUD, hence a lot of applications will be migrated 1 to 1.•Easy to move large amout of data to CLOUD as it would be possible to set up replication links between on-prem and CLOUD.•VENDOR can do capacity overallocation to further reduce cost of storage. There is no overallocation possible with native CLOUD storage•Benefit from the VENDOR compression for further cost reduction•Such service would offer:

• A simple tier for migration to CLOUD• Ability to use Active-Active and Sync replication between separate Availability Zones in

CLOUD which would be very helpful.• Ability to use snapshots for easy data protection• Performance – storage bandwidth is high and latency is important (IOPS are less

important)


Meet INFINIDAT Neutrix Cloud

Neutrix CloudOn-Prem / Co-Lo

VMware on AWS

Use Case 1: DisasterRecovery

Use Case 2: Cloud-Adjacent Storage

Use cases 1 and 2 can be combined to enable true hybrid cloud workflows — DevOpsv CI/CD etc

• Low, predictable latency• Secure dedicated connection• Economic savings

(NFS/iSCSI)


Summary

§ Clouds offer reach selection of storage solutions§ developed for apps that don’t expect HA

infrastructure § “Lift and shift” approach for a traditional

enterprise workload is problematic§ There is a major area for cloud storage improvements

§ And an opportunity for Enterprise storage solutions in or near public clouds


Key takeaway: today’s public cloud storage offerings are not good enough for “lift and shift”

enterprise workloads

the cloudiest storage - snia · benefits of having vendor storage in the cloud •not all...

Documents