choosing right all-flash-array - atea · next generation applications trend paas, mobile, hadoop...

1© Copyright 2015 EMC Corporation. All rights reserved.

Choosing Right All-Flash-Array

Aleksandr ShvadtshenkoSr. Systems [email protected]


INDUSTRY TRENDS – A FEDERATION PERSPECTIVE

HOW 5 TRENDS ARE INTERCONNECTED

Flash TrendNew Levels of Performance

COTS TrendNew Levels of Efficiency

Software-Defined Data Center Trend

Hybrid Cloud Trend

Next Generation Applications TrendPaaS, Mobile, Hadoop

Converged Infrastructure Trend

2 Key Changes To The Underlying Storage Market

Elastic, Agile, Data Center Running Next Generation Apps

Which Will Be Deployed In CI

Which Will Be Used As Building Blocks

Which Will Enable Hybrid Clouds


0 1 2 3 4 5 76

Years Since Product Availability

0

100

200

300

400

500

600

700

800

900A

nn

ual B

oo

kin

gs (

$M

)

$1BN


• This research shows that

flash will become the lowest

cost media for almost all

storage from 2016 and

beyond, and that a shared

data philosophy is required

to maximize the potential

from both storage cost and

application functionality

perspectives.

Evolution of All-Flash Array Architectures

http://wikibon.org/wiki/v/Evolution_of_All-Flash_Array_Architectures

http://wikibon.org/wiki/v/Evolution_of_All-Flash_Array_Architectures


The All Silicone Data

Center


Why Flash?

Challenge #1:

• Latency– Bad user experience

– Application timeout

– Lost time = money


Why Flash?

Latency cause: CPU – HDD performance gap

2000 2010 2020

LATENCY

10000x100x 800x

CPU IS FAST AND GETS FASTER×DISK IS SLOW AND DOES NOT GET ANY FASTER


Why Flash?

Solution: Flash will close the performance gap

2000 2010 2020

10000x100x 800x

CPU IS FAST AND GETS FASTER

FLASH IS FAST AND GETS FASTER


XtremIO Sudden Impact - SQL Server


The Evolution of “FLASH” Arrays

Flash Optimized Hybrids• Dual Controller

• Limited Scale

• Single Workloads

• Some Data Services

Gen 2

Scale Up All Flash Arrays• Dual Controller

• Limited Scale

• Single Workloads

• “Sometimes” Data Services

• Compromise Between

• Performance &

• Efficiency - Data Svcs

Gen 3

Scale Out All Flash Arrays

• Multi Controller (16-XtremIO)

• Petabyte Scale

• Mixed Workloads

• In-Line Data Services

• Lowest TCO

• Highest Performance

• All Flash Data Center

Gen 4

Gen 1

Fla

sh S

yste

ms

Legacy D

isk A

rrays

Gen 1

Source: Wikibon December 2014


Changing Tides…

Gartner 2013 AFA Market Share IDC 1H 2014 AFA Market Share

Revenue ($M) Share (%)

EMC 112.3 22.6

Pure 90.0 18.3

IBM 82.9 16.7

Revenue ($M) Share (%)

EMC 1,575.8 35.5

NetApp 891.8 20.1

Hitachi 521.2 11.7

IDC 1H 2014 HFA Market Share


CONSISTENT & PREDICTABLE PERFORMANCE @ SCALE(NO SYSTEM-LEVEL GARBAGE COLLECTION)

Why Architecture Matters: Key Ingredients

sub 1ms latency

Linear Scale IOPS & Capacity

Software-DefinedSCALE-OUT

Writeable Snapshots

Flash Data Protection

Deduplication

Thin Provisioning

Compression

Encryption

Data Reduction Efficiencies

Inline & UnstoppableDATA SERVICES

HA/DR, Management, Converged

EMC PortfolioINTEGRATION

SRM

PowerPath

RecoverPointVPLEX


Avoiding Bad Design Choices

5 Common Things AFAs Borrow from Disk

Log Structuring

Metadata De-stage

RAID

Post-Process

Parity

Parity

Parity

Parity

Uneven SSD wear

Performance inconsistency

SSD Wear - Write Amplification

Performance inconsistency

XTREMIO DOES NOT USE ANY OF THESE

Asymmetric Controllers Uneven Resource UtilizationPA P

14© Copyright 2014 EMC Corporation. All rights reserved. 14© Copyright 2014 EMC Corporation. All rights reserved.

XTREMIO DATA PROTECTION

• Designed for SSD

• No legacy RAID baggage

• Highly efficient- only 8% overhead

• Lowest write amplification

• SSDs may fail in place

• No configuration

• No hot spares

• Adapts to failures

Good CapacityUtilizationRAID 5

HighPerformance

RAID 1

SuperiorProtection

RAID 6

XDP


Array Controller

Typical AFA System Level Garbage Collection

• Huge back-end I/O amplification initiated by array controller• Cannot defer process when array must free up space• Big tax on array controllers to manage – limits capacity


XtremIO Controller

XtremIO – No System Level Tax

• SSD controllers have ideal knowledge of the NAND• Zero back-end I/O initiated by the array controllers • No tax on array controllers

ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC

Performed by Each SSD Controller ASIC

No Garbage Collection


Scale Up XtremIO Scale Out

Controller 2

Controller 1

Controller 4

Controller 3

Controller 6

Controller 5

Controller 8

Controller 7

Controller 10

Controller 9

Controller 14

Controller 13

Controller 16

Controller 15

Controller 12

Controller 11

SC

ALE

AC

TIV

E

SC

ALE

AC

TIV

E

15

0K

IO

PS

2

M I

OP

S

16

AC

TIV

E C

ON

TR

OLLER

S

Passive Active

Flash

Flash

Flash

SAN


Why Customers Choose XtremIO

Consistent High Performance & Low LatencyActual customer data | Workload: OLTP with 8KB Block Size

Traditional Flash ArrayXtremIO ‘X-Brick’

Late

ncy Latency Spikes • 2-4.5ms = Gen 3 Flash

• Various latency spikes

• <1ms = XtremIO• Consistent & Predictable (~0.5ms)

Late

ncy • 20-40ms = Gen 3 Flash

• Latency increases with capacity

• <1ms = XtremIO• Always Consistent & Predictable

System-Level Garbage Collection Impact

Worse than Disk Latency


XtremIO X-Brick

Cluster Building Block

Active Controller 1

Active Controller 2

Infiniband RDMA

32CPU

CORES

512GB

RAM

25eMLCSSDs

SAS 2.0SAS 2.0

2 x FC2 x iSCSI

4HOSTPORTS

2 x FC2 x iSCSI

256GBRAM

256GBRAM


X-Brick 3

X-Brick 1

X-Brick 2

X-Brick 4

SHARED MEMORY METADATA








RDMAFABRIC

Unique User Data

Unique User Data

Unique User Data

Unique User Data

How Does It Scale?


5–320TB physical, PBs effective capacity based on 10, 20, & 40 TB X-Bricks

NO TUNINGSCALE-OUT RICH DATA SERVICES<1ms LATENCY

© Copyright 2015 EMC Corporation. All rights reserved.

Starter 5TB

Product Family,

On-Demand Linear Scale-Out

150K mixed IOPS250K read IOPS<1ms Latency

From 2 – 16 N-way Active Controllers1.2M mixed IOPS

2M read IOPS<1ms LatencPBs Capacity


100% PERFORMANCEIdentical read IOPSIdentical write IOPSIdentical latency

INCREDIBLE SCALEInstant application clones to petabyte scale

100% OPTIMIZEDIdentical data servicesAlways on, always inline

UNMATCHEDUse XtremIO where all-flash arrays were never before viable

100% IN-MEMORYAny topologyInstant creationInstant deletion

100% SPACE EFFICIENTNo space reservationsNo metadata bloat

Agile Writeable Snapshots


Today’s Applications Environment

PRODUCTION

6DATABASECOPIES 3 ARRAYS/POOLS 1

USE CASE FOR FLASH

LIMITEDTEST/DEVCOPIES

BruteForceCopy

BruteForceCopy

DATAMARTCOPIES

JUST

ONEAPPLICATION


Game-Changing Consolidation, Agility

1 XTREMIO CLUSTER1 0DATABASEINSTANCES 0

BRUTE FORCE COPIESx

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

TEST/DEV COPIES HIGH PERFORMANCE PRODUCTION

FREE, FAST DEV/TEST

DATAMART COPIES

FIN COPY

OPS COPY

SALES COPY

FREE, FAST ANALYTICS

FIN COPY

OPS COPY

SALES COPY

REPORTS

ANALYTICS

TRENDS

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

SCALE-OUTIOPS IN

ABUNDANCE

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

XTREMIOFLASH FOR

ENTIREAPPLICATION

FASTERAPPLICATIONDEVELOPMENT

TIMES

MOREBUSINESS

PRODUCTIVITY

FIN COPY

OPS COPY

SALES COPY

FIN COPY

OPS COPY

SALES COPY

REPORTS

ANALYTICS

TRENDS


XtremIO Simplicity & Automation

1CREATEVOLUMES

2CREATEINITIATORGROUPS

Management Impact:

• Zero Planning & Tuning

• No storage skills

• No certifications

• Provision in seconds!

Integration:

• VMware vCenter

• EMC ViPR, ESA, ESI, SRM

• Microsoft Hyper-V

• App Consoles: Oracle, SAP,

System Center, etc

• REST API & CLI

3MAPVOLUMES


XtremIO: Leading Use Cases

• Consolidate production, dev/test, BI/analytics/reporting instances

• Solve the toughest SLA challenges

• TCO savings across storage, servers, app licensing

Database &

Business Apps

• Uncompromising user experience, at scale and all desktop types

• Scale-out as VDI grows for any mix of desktop types

• Lowest Opex & Capex, <$100/Desktop

Virtual Desktops

& DaaS

• Private cloud mixed workload consolidation

• Mission-critical app virtualization

• Application-as-a-Service

• Software Dev/Ops Infrastructure

• Cloud-scale TCO savings for Capex and Opex

Cloud & Virtual Servers Infrastructure

Best User Experience

Consistent Performance

ProvisioningSimplicity

EMC PortfolioSynergy

No Complex Setup/tuning


* The rates listed above are only examples and do not necessarily reflect real life values

Data Reduction Guidelines

Below are a few examples for data reduction rates:

Use Case Dedupe Ratio Compression Ratio Data Reduction Ratio

VDI (full clones) 6:1 – 10:1 1.3:1 - 1.5:1 7.8:1 – 15:1

VDI (linked clones) 1.5:1 1.3:1 - 1.5:1 2:1 – 2.3:1

Virtual Servers 1.5:1 – 3:1 1.3:1 – 2:1 2:1 – 6:1

SQL Server 1.1:1 1.5:1 – 1.8:1 1.6:1 – 2:1

Oracle DB 1.1:1 2.2:1 – 2.5:1 2.4:1 – 2.8:1


MAINTENANCE PRICE PROTECTION

7 YEARS

3-YEAR MONEY-BACK WARRANTY

2014-2017

FLASH ENDURANCE PROTECTION

7 YEARS

* For qualifying customers through December 31, 2015. See EMC.com/XpectMore for details, terms and conditions.

XPECT MORE PROGRAM*

EMC IS REDEFINING THE STORAGE LIFECYCLE


The Rise of Server SAN

http://wikibon.org/wiki/v/The_Rise_of_Server_SAN

http://wikibon.org/wiki/v/The_Rise_of_Server_SAN


2ND AND 3RD PLATFORM ARCHITECTURE

COTS, Storage SoftwareBlades, Virtualization, Arrays


EMC SCALEIOSOFTWARE-DEFINED, SCALE-OUT

Utilize commodity hardware for block storage

Run storage and applications on the same servers

Experience flexible & scalable performance & capacity on demand

Choose your operating system, hypervisor and media


agnostic

Bare Metal

PCIe Flash

SSDs

HDDs


Mapping storage: RAW DEVICE or partition

ScaleIO architecture:


Mapping storage: RAW DEVICE or partition



• Utility Distributed with SDS Windows Software

• Prepares a File to use in ScaleIO.

• .\create_file_storage.exe --create_file --size_gb 100 --file_name c:\scaleio1.bin

• Can be used in the CSV Deployment Manager

Mapping device: FILE WITH PREPARE_FILE utility



scaleIO hyperconvergance: resource utilization


• Impact on server is below 10% CPU load– Usually far below

Maximum IOPS load on 10K pool

Maximum IOPS load on SSD pool


• Dynamically add, move, remove storage and compute resources “on the fly” with no downtime

• Automatic volume rebuilds and rebalancing

• Mix– Server brands

– Configurations

– OS platforms (physical & virtual)

– Devices (SSD, HDD, PCIe, LUNs, partitions, files)

• No capacity planning required!

Automatic data rebalancing

ScaleIO


• Auto-balance of resources across nodes/clusters

• Auto-rebalance when resources are added

• Auto-rebuild when resources fail or removed

Elastic architectureAdd, remove, re-allocate, on the fly

BALANCED

BALANCED

BALANCED

BALANCED

BALANCED

Easier Capacity Planning No Migrations


Scalability

ScaleIO

• Scale to thousands of nodes

• Add devices and servers to increase capacity and performance

• Storage growth always aligned with application needs

2048 nodes in one single cluster

64devicesper node

6TBdevice16PB

percluster


PERFORMANCE Scales Linearly

ScaleIO

• ~31M IOPs is about 8X better than the latest high-end HDS storage (G1000) for a fraction of the cost

• If we were to extrapolate the lines, we would get ~180M IOPs for 1024 Nodes (~46 G1000 systems…)


SUB-MILLISECOND LATENCY

ScaleIO

Typical read latency figures with flash and 10GbE

Write figures are ~1.5X to 2X

4KB: 304 usec 8KB: 344 usec 128KB: 778 usec

Measured from the application perspective


PERFORMANCE

MB/S & IOPS

READS/WRITES

VIEW AGGREGATE

CAPACITY

SCALEIO NODE COUNT

• Automated installation scripts and easy configuration

• Manage the entire data center stack from single UI

• Monitor HW/SW failure recovery—no administrative intervention required

• Options: CLI, UI, REST, ViPRController, ViPR SRM, vSphere, OpenStack

System wide visibility, cost effective management at scale

ScaleIO

45© Copyright 2015 EMC Corporation. All rights reserved.© Copyright 2015 EMC Corporation. All rights reserved.

Enterprise Grade

PERFORMANCE INTEROPERABILITY MONITORING FAULT TOLERANCE RESILIENCY

MULTI-TENANCY PROTECTION SECURITY ELASTICITY EFFICIENCY

SNMP &Call Home

OpenStack &vSphere

Data MaskingProtection Domains & QoS

Controls

Flash Cache &XtremCache

RecoverPointRack LevelHigh Availability

Automatic Rebalance &

Rebuild

Thin ProvisioningWriteableSnapshots

APP 1

APP 2

APP 3


Use CasesANY APPLICATION THAT USES BLOCK STORAGE

ANALYTICSNEXT GEN APPLICATIONSTRADITIONAL APPLICATIONS


EMC ScaleIO node

• Bundled EMC commodity servers and ScaleIO software

– Fully architected

– Simplified planning and building

– Pre-validated, tested and configured

– Single vendor fully supported


SUPREMEELASTICITY

MASSIVESCALABILITY

UNPARALLELED FLEXIBILITY

EXTREME PERFORMANCE

COMPELLING ECONOMICS

30-60%

TCO Savings

Up To

1k+NODES

Scales To

EFFICIENCY

50%

Over Traditional SAN

8xATTAIN

better performance than

TRADITIONAL SAN


.Next Steps

DownloadFree & Frictionless version of ScaleIO

Visit EMC.com/ScaleIO

Join the ECN ScaleIO Product Community

Follow Us on Twitter @EMCScaleIO

where you’ll have access to

whitepapers, videos, demos etc.

http://emc.com/products-solutions/trial-software-download/scaleio.htm

http://emc.com/products-solutions/trial-software-download/scaleio.htm


ScaleIO POC results in Estonia


2ND AND 3RD PLATFORM ARCHITECTURE

COTS, Storage SoftwareBlades, Virtualization, Arrays


ViPR CONTROLLER CLOAKS & MANAGES ALL

Control

Abstraction

IsilonVMAXEMC

ScaleIOVNX VBLOCK XtremIO

DIAMOND

GOLD

SILVER

BRONZE


ViPR service catalog

choosing right all-flash-array - atea · next generation applications trend paas, mobile, hadoop...

Documents