monster trends in enterprise tech: the flash disruption and what it means for database and business

18
© Wikibon 2008 © Wikibon 2014 www.wikibon.org 1 [[The Wikibon Project]] Monster Trends in Enterprise Tech The Flash Disruption, & what it Means for Database & Business David Floyer CTO & Co-founder, The Wikibon Project 1

Upload: stein-writes-inc

Post on 25-Dec-2014

149 views

Category:

Data & Analytics


2 download

DESCRIPTION

David Floyer, CTO of Wikibon, made this presentation at the June 2014 Meetup of the Silicon Valley Database Meets SSD Meetup. See: http://www.meetup.com/db-speed-sv/files/

TRANSCRIPT

Page 1: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2014 www.wikibon.org

1

[[The Wikibon Project]]

Monster Trends in Enterprise Tech

The Flash Disruption, &

what it Means for Database &

Business

David Floyer

CTO & Co-founder,

The Wikibon Project

1

Page 2: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2014 www.wikibon.org

Key Trends

2

IoT

Fog Computing

Flash

Page 3: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2014 www.wikibon.org

Key Trends

3

IoT

Fog Computing

Flash

Page 4: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

• CIO's should expect that high value, revenue-producing

applications will be most affected by these changes. As such

there is an opportunity to improve the amount of data that can

be processed within a transaction by 1,000X. This means

organizations will be able to dramatically enhance the quality,

performance, and end-user experience of their most important

IT application assets.

• Vendors have seen a steady migration of storage function

away from the processor for the past two decades, creating a

multi-billion dollar storage software market. Function will

increasingly migrate back toward the processor creating a

dislocation that is both an opportunity and threat to

established array vendor software franchises.

The Flash Attack

4

Page 5: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2014 www.wikibon.org

How Flash Helps Existing Apps

• Speeds them up: milliseconds to

microseconds

• Wikibon Case Study: Revere * (200 person)

• Before: Only Call Center in Prime-time

• After: All departments could operated in Prime-

time

• Business benefit: 20% growth with no additional

people, $1 Million to the bottom line

• Cost: 1 Flash card

• ROI: almost infinite, with <3 month break-even * Reference: http://wikibon.org/wiki/v/Case_Study:_The_Hunting_of_the_RARC

Flash Memory Summit 2013

Santa Clara, CA

5

Page 6: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

• Customers can add to current architectures & protocols (e.g. Bolt on

SSDs and flash for read IOs) but unless you have a “write to flash

first” architecture with a single master copy which primarily resides

in flash – you’ll never be able to scale.

• Without a “write to flash first” architecture, the cost of software and

hardware at scale become prohibitive

• This ripples thru to OPEX because the amount of effort required at

scale to tune the system is expensive

• Traditional arrays today don’t scale well- i.e. Ones that use “Flash

Cache” (reads) and SSD (writes). The problem w/SSD is you have

to manually allocate the volume – too hard and too expensive

• All-Flash Arrays with De-duplication & Compression gives

competitive costs with tiered storage with lower OPEX costs - give

very consistent performance for database

• Application-led Open-source Server SAN - In general, the more

integration that can be done closer to the application…costs will be

lower, performance better and value higher

Hybrid & All-Flash Arrays

6

Page 7: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

Flash & Database

7

Page 8: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2014 www.wikibon.org

Design & Architecture Problems

• DRAM non-persistent, Write-time to

acknowledgement key problem

• Elapsed Time milliseconds (20-200ms)

• Variance very high (for Databases)

• Limits Design for Transactional Applications

• 100DB calls/transaction

• Limits Scope of Analytic Systems (DRAM?)

• Modular Systems, difficult to deploy,

business fits to application

Flash Memory Summit 2013

Santa Clara, CA

8

Page 9: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

Atomic Storage

9

• Atomic Storage reduces

latency from milliseconds

to microseconds

• Latency Variation as

important (or more

important) as Average

Latency for Databases

• SCSI overhead must be

tackled:

• PCIe primitives

• NVM on Memory Bus

Page 10: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

Workload Differentiation

10

Page 11: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

Technology Trends

11

Page 12: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

Flape – Flash & Tape

12

Page 13: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

A Word on Converged Infrastructure

13

Wikibon recently interviewed Wikibon members who

have adopted converged infrastructure solutions in

Oracle environments. From these findings and other

research, Wikibon has calculated that IT executives

can expect savings of 40% to 50% in costs or

equivalent value by adopting an aggressive on-

premise IaaS with the minimum number of SKUs, even

after taking into account the higher costs of highly

converged solutions. In a detailed analysis of Oracle

DBA productivity Wikibon shows that by adopting best

practices in Oracle environments, database admin

(DBA) productivity is improved by 50%.

Page 14: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

14

Converged Infrastructure

Page 15: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

15

Converged Applications

Page 16: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

Converged Application Business Case

16

Page 17: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

One-size Does Not Fit All

17

Server SAN

Page 18: Monster Trends in Enterprise Tech: The Flash Disruption and What it Means for Database and Business

© Wikibon 2008 © Wikibon 2009 | Confidential www.wikibon.org www.wikibon.org © Wikibon 2014

• Flash on Memory (NVDRAM)

– Early days

• Other NVM Technologies

– PCM, Memristor – 5-years out

• Flash will drive New Applications solving

New Business Opportunities

Futures

18