why software-defined storage matters

18
WHY SOFTWARE-DEFINED STORAGE MATTERS Ross Turk Red Hat Storage January 2016

Upload: redhatstorage

Post on 06-Jan-2017

801 views

Category:

Technology


1 download

TRANSCRIPT

WHY SOFTWARE-DEFINED STORAGE MATTERSRoss TurkRed Hat StorageJanuary 2016

STORAGE IS A BIG PART OF IT BUDGETS

Storage is a top 3 spending category in any large infrastructure project, alongside

servers and networking.

Storage in the enterprise has been growing at 40%+ per year, and there is no

sign this growth trend is slowing.

A very large share of IT budgets is spent on storage solutions.

2018 TOTAL ADDRESSABLE MARKET (IN BILLIONS)

$18.1

$15.2$12.3

$10.3

$16.0OS

MIDDLEWARE

EMERGING

STORAGE

MANAGEMENT

Traditional StorageComplex proprietary silos

Open, Software-Defined StorageStandardized, unified, open platforms

Custom GUI

Proprietary Software

ProprietaryHardware

StandardComputersand DisksSt

anda

rdHa

rdwa

reOp

en S

ourc

eSo

ftwar

e

Ceph Gluster +++

Control Plane (API, GUI)

ADMIN USER

THE FUTURE OF STORAGE

ADMIN

USER

ADMIN

USER

ADMIN

USER

Custom GUI

Proprietary Software

ProprietaryHardware

Custom GUI

Proprietary Software

ProprietaryHardware

WHAT IS SOFTWARE-DEFINED STORAGE?

STORAGE VIRTUALIZATIO

N

STORAGE ORCHESTRATIO

N

Storage virtualization is the use of software and standard hardware to provide services traditionally provided by single-purpose storage appliances (similar to server virtualization, which uses software to

emulate servers), providing increased agility and efficiency.

DISTRIBUTED CLUSTER OF SERVERS

MEDIA

MEDIA

MEDIA

MEDIA

MEDIA

MEDIA

MEDIA

APPLIANCE

MEDIA

MEDIA

APPLIANCE

MEDIA

MEDIA

APPLIANCE

MEDIA

MEDIA

USER USER USER

STORAGE VIRTUALIZATION

USER USER USER

FLEXIBILITY IS CRUCIAL

STORAGE APPLIANCE

COMPUTE NODE + + + +

+

STORAGE NODE

COMPUTE NODE + + + +

+ + + +

+

+

+

+

+

+

+

+

VIRTUALIZED STORAGE SCALES BETTER

STANDARD SAN/NAS IS ON THE DECLINE

Server-based storage is “will account for over 60% of shipments long term.”

“By 2016, server-based storage solutions will lower storage hardware costs by 50% or

more.”Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry”

Credit Suisse Storage Update, September 3, 2015

Changing workloads drive the need for flexible, economical server-based

storage.

WW DEPLOYED CAPACITY (TB)

2010

2011

2012

2013

2014

2015

(est)

2016

(est)

Source: IDC

0%

60%

20%

40%

80%

100%

Internal Capacity

External Capacity

WHAT IS SOFTWARE-DEFINED STORAGE?

STORAGE VIRTUALIZATIO

N

STORAGE ORCHESTRATIO

N

STORAGE ORCHESTRATION

Storage orchestration is the ability to provision, grow, shrink, and decommission storage resources on-demand and programmatically,

providing increased control and integration of storage into a software-defined data center.

WEB CONSOLEA browser interface designed for managing distributed

storage

APIA full API for automation and integration with outside

systems

COMMAND LINEA robust, scriptable command-

line interface for expert operators

PROVISION INSTALL CONFIGUR

E TUNE MONITOR

Full lifecycle management for distributed, software-defined data services

UNIFIED STORAGE MANAGEMENT

A RISING TIDE

“By 2020, between 70-80% of unstructured data will be held on lower-cost storage managed by SDS”

“By 2019, 70% of existing storage array productswill also be available as software only versions”

Innovation Insight: Separating Hype From Hope for Software-Defined Storage

Innovation Insight: Separating Hype From Hope for Software-Defined Storage 2013

2014

2015

2016

2017

2018

2019

$1,349M

$1,195M

$1,029M

$859M

$706M

$592M

SDS-P MARKET SIZE BY SEGMENT

$457M

Block StorageFile StorageObject StorageHyperconverged

Source: IDC

Software-Defined Storage is leading a shift in the global storage

industry, with far-reaching effects.

THE BALANCE

InflexibleExpensive at large scale

DurableConvenient

FlexibleEconomical at large scale

DurablePowerful

Appliances are suitable for small-scale, workloads, but they do not

scale economically.

Software-defined storage has a learning curve, but bring

performance and economy at petabyte scale.

WHY BOTHER?

PROPRIETARYHARDWARE

HARDWARE-BASED INTELLIGENCE

SCALE-UPARCHITECTURE

CLOSED DEVELOPMENT PROCESS

Common, off-the-shelf hardwareLower cost, standardized supply chain

Scale-out architectureIncreased operational flexibility

Software-based intelligenceMore programmability, agility, and control

Open development processMore flexible, well-integrated technology

THE RED HAT STORAGE PORTFOLIO

Cephmanagement

OPEN

SOU

RCE

SOFT

WAR

E

Glustermanagement

Cephdata services

Glusterdata services

STAN

DARD

HARD

WAR

EShare-nothing, scale-out architecture provides durability and adapts to changing demands

Self-managing and self-healing features reduce operational overhead

Standards-based interfaces and full APIs ease integration with applications and systems

Supported by theexperts at Red Hat

What is it, fundamentally?

A distributed object storage platform A scale-out file system

What can it store? Block devices (krbd + librbd)Objects (S3/Swift + librados)

Files (SMB, NFS) with some object and block capabilities

How does it place data? Policy-based algorithm Hash-based algorithm

Smallest cluster 5 nodes 2 nodes

Largest cluster 1000s of nodes 128 nodes

Where is it deployed? Datacenter DatacenterPublic / hybrid cloud

What’s it used for? Building next-generation infrastructure

Supporting scale-out applications

PRODUCT DIFFERENTIATION

GROWING INNOVATION COMMUNITIES

Over 11M downloads in the last 12 months Increased development velocity, authorship, and

discussion has resulted in rapid feature expansion.

Contributions from Intel, SanDisk, CERN, and Yahoo.

Presenting Ceph Days in cities around the world and quarterly virtual Ceph Developer Summit events.

78 AUTHORS/mo

1500 COMMITS/mo

258 POSTERS/mo

41 AUTHORS/mo

259 COMMITS/mo

166 POSTERS/mo