fixing the broken storage model: a storage hypervisor at last

48
Fixing The Broken Storage Model: A Storage Hypervisor At Last Jon Toigo CEO Toigo Partners International Chairman Data Management Institute

Upload: ipexpo-online

Post on 20-Aug-2015

697 views

Category:

Technology


2 download

TRANSCRIPT

Fixing The Broken Storage Model: A Storage Hypervisor At Last

Jon Toigo CEO Toigo Partners International

Chairman Data Management Institute

Welcome and Overview

• Three questions to address: • What is the broken storage

model…and who broke it? • What is a “storage hypervisor?” • How can a storage hypervisor

help?

• All in 30 minutes! (Whew.)

Copy

right

© 2

011

by T

oigo

Par

tner

s Int

erna

tiona

l LLC

. Al

l Rig

hts R

eser

ved.

Define “Broken” • bro·ken [broh-kuh’n]

– Out of working order, malfunctioning – Disunited or divided – Bankrupt, ruined, lacking efficiency

• Storage technology is inefficient – From an engineering perspective – From an operational perspective – From a budgetary perspective

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Engineering-wise • Disk keeps getting bigger and cheaper, but…

1980 2010 Sub-MB

TB+

CAPA

CITY

(A

real

Den

sity

= G

b pe

r in2 )

COST PER G

B

HIGH

LOW

ARRAY COSTS ACCELERATING

Source: “Avoiding the Storage Crunch,” Jon Toigo, Scientific Am

erican

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

“Creeping Featuritus”- Blurring the Lines…

Prob

abili

ty o

f Reu

se

100

0

“Primary Storage”

“Secondary Storage” Accesses to Data

0 days 30+ days 90+ 1 yr ∞ Time

milliseconds seconds minutes hours days Access Speed

“Retention Storage” “Tertiary Storage”

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Why All of the “Value Add?” • Differentiation of otherwise commodity

hardware requires value-add functionality – Publicly-traded OEMs must “innovate” (aka “add

value via software embedded on array controller”) every 6-8 months, or risk losing market analyst interest

– Embedded software used to lock in customer/lock out competitors

– Portrayed as “one-stop-shop” or “pre-integrated” or “intelligent or smart(er) product” with purported TCO reduction value

– Software costs nearly $0 to mass produce – a plus

All drives and enclosures from

handful of OEMs

RAID dates to 1977: freeware

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Oh, and Value Add adds Profit • For example: A popular de-duplication solution

vendor offers two kinds of de-duplication rigs A. Software only

• Licenses software separately for $2500 per TB • Run on a server, use any storage you have

B. Software plus hardware • 32 TB of commodity SATA disk storage with embedded

software = $410,000 MSRP (or $12,812.50 per TB) • 1 TB SATA disk costs $79 - $140 on NewEgg.com

(~$3200 for 32 TB) • Vendor’s “value-add” rig costs $80K for software, $330K

for disks or 100x the cost of the disks themselves

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Resulting Infrastructure C

opyr

ight

© 2

011

by T

oigo

Par

tner

s In

tern

atio

nal L

LC.

All

Rig

hts

Res

erve

d.

Not to Mention • Inflexible infrastructure design in the face of

changing workload demands • Higher failure rates because of incomplete

interoperability testing matrix data • Scaling challenges (services and hardware) • Performance challenges • Lack of predictability (units of storage)

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

From the Operational Perspective • Heterogeneous “value-

add” storage is making life miserable – No unified cross-platform

management capability for “meta-management tasks”

• Capacity • Performance • Data protection

– No unified management for “hardware and plumbing” to facilitate troubleshooting or tuning

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Last Year… • Roughly 7% of 40.5M disk drives failed = 2.8M drives

– per Google, Carnegie Mellon and IDC reports • Downtime from outages at 3000 US/European firms

= 127M hours (like paying 65,000 persons full time wages for a year-long holiday from productive work) – per a study commissioned by CA Technologies

• The annual operational costs of storage (administration, manual management, environmentals) were 4x the cost of hardware acquisition (and firms currently implementing server and desktop virtualization are expected to grow their storage infrastructure capacity 600% over the next three years) – per Gartner

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

• From a financial perspective, storage cost looks like a nail in search of a cost cutting hammer…

Not Surprising, The Bean Counters Aren’t Thrilled about the Cost…

Or maybe, something better outsourced to “clouds”…

(Got C.V.?)

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Storage is Financially Inefficient

33-70%

of the IT hardware budget…

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Add to That… • Warranty and maintenance agreement costs • Annualized value-add software license costs • Installed “hot spare” drives • “Signed drives” • Wire, switch, HBA/NICs… Few other industries make as

much money by cutting down their product…

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

And CAPEX is only a Fraction of Storage Total Cost of Ownership…

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

“Unsustainable” • So, what is the latest advice?

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Another Option: A “Storage Hypervisor”

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

A Storage What? • Hypervisor.

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

A Storage Hypervisor Creates a Software Abstraction Layer – A Virtual Array Controller

VIRTUAL CONTROLLER

Copy

right

© 2

011

by T

oigo

Par

tner

s Int

erna

tiona

l LLC

. Al

l Rig

hts R

eser

ved.

Providing Centralized Management

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

And an Extensible Services Platform Thin Provisioning Replication Auto-Tiering CDP

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

In a Hardware Agnostic Way

Using “virtual storage pools” comprising any arrays interconnected via any interconnect technology…

Storage served as either block or file volumes…

Data provided with appropriate set of value-add services…

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Server Hypervisor Computing Has Laid Bare Some Key Points

The x86 Server is a commodity…

Applications and operating systems don’t care about the brand of gear on which they are hosted.

Software is portable…

Done correctly, with careful planning and good management tools, abstracting software away from hardware can simplify

infrastructure and reduce cost of ownership…

Server hardware is just a building block with known resources and performance capabilities.

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Equally Applicable to a Storage Hypervisor…

Media capacities and interfaces aside, storage arrays are commodity gear…

Most value-add applications don’t need to be hosted on HW array controllers.

Software is portable…

Done correctly, with careful planning and good management tools, abstracting software away from storage hardware can simplify

infrastructure and reduce cost of ownership…

Storage hardware is ideally just a building block with known resources and performance capabilities. It can be surfaced/presented as block or file storage readily…

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Several Ways to Implement Storage Hypervisor implemented on a

generic server… Use array mount points already established

with server OS… Aggregate storage capacity as desired into

one or more virtual resource pools… Service I/O from server memory for 2X or

more performance bump, regardless of back-end hardware…

Manage capacity, performance and data protection in a unified way…

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

The Front Office Will Be Pleased, Too. Real “unified management” with fewer administrators

“Defense in depth” for critical data assets, with real-time monitoring and control

Failover/Failback for maintenance: no maintenance downtime

Improved power economics by using everything you have

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

Bending the Cost Curve

Cop

yrig

ht ©

201

1 by

Toi

go P

artn

ers

Inte

rnat

iona

l LLC

. A

ll R

ight

s R

eser

ved.

An Immediate Solution to the Big Problem of Server Virtualization…Storage Inflexibility!

Copy

right

© 2

011

by T

oigo

Par

tner

s Int

erna

tiona

l LLC

. Al

l Rig

hts R

eser

ved.

And Going Forward… Storage Hypervisors

Could Provide the “Rosetta Stone” For Cloud I/O Integration

EGYPTIAN

DEMOTIC

GREEK

Copy

right

© 2

011

by T

oigo

Par

tner

s Int

erna

tiona

l LLC

. Al

l Rig

hts R

eser

ved.

Best of Breed

Copy

right

© 2

011

by T

oigo

Par

tner

s Int

erna

tiona

l LLC

. Al

l Rig

hts R

eser

ved.

Hope it helps. • Questions? • Thanks.

• Keep in touch

– Email: [email protected] – Twitter: @jontoigo – Blog: www.drunkendata.com

• Copies of these slides available at http://www.toigopartners.com/Toigo_Storage_Hypervisor.ppt Co

pyrig

ht ©

201

1 by

Toi

go P

artn

ers I

nter

natio

nal L

LC.

All R

ight

s Res

erve

d.

THE WHOLE TECHNOLOGY

STACK

from start to finish

COMMENT & ANALYSIS

Insights, interviews and the latest thinking on technology solutions

VIDEO Your source of live information

– all the presentations from our live events

TECHNOLOGY LIBRARY

Over 3,000 whitepapers, case studies, product overviews and press releases from all the

leading IT vendors

EVENTS, WEBINARS & PRESENTATIONS

Missed the event? Download the presentations that

interest you. Catch up with convenient webinars. Plan your next visit.

Directory A comprehensive A-Z listing

providing in-depth company overviews

ALL FREE TO ACCESS

24/7

online.ipexpo.co.uk