qumulo confidential bob collins qumulo regional sales manager [email protected]@qumulo.com, twitter:...

26
Qumulo Confidential Bob Collins Qumulo Regional Sales Manager [email protected] , Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer Qumulo Overview

Upload: marilynn-page

Post on 02-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Bob CollinsQumulo Regional Sales [email protected], Twitter: 350Zbob,

972.489.8577

Paul LevineSenior Systems Engineer

Qumulo Overview

Page 2: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Data Aware Scale-Out NAS

NAS Generations

Scale-Out Clustered NAS

Scale-UpGeneral Purpose NAS

1980s 1990s 2000s 2010s

Page 3: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Storage architectures today are a lot like…

Page 4: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

About Qumulo 3+ year-old storage company in Seattle, WA Founders invented Isilon OneFS and “Scale-out NAS” (55/62

patents) Over 10 PBs shipped after only a few months after GA! 600+ research interviews and ongoing active engagement

feeding solution development Raised $67M in Series B funding from top venture firms Record number of new customers and bookings in 1H ‘15

Page 5: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

600+ Interviews - Enterprise Storage Pain

“Data manageability is probably

our greatest weakness.” Major US Electric Utility

“We have aPandora’s box of

storage.” Leading US Retailer

“Sadly, capacity planning

is a wild ass guess.”Large US Insurance Company

“We drop files into a folder

and lose them forever.”

Hollywood Special Effects House

Page 6: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Page 7: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Major Shift in Enterprise Storage

Page 8: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Managing Storage vs. Managing Data at Scale

Scale-OutStorage Architectures

Managing Storage (2000s)

Managing Data (1990-present)

Managing Storage (1990s)

Admin Time

Data Under Management

Source: Qumulo Customer Development Research

Page 9: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Software-Only Storage System

Page 10: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Making Storage InvisibleData-Aware Scale-Out

Proprietary OS

NVRAM HDD

NFS CLIWebUI

x86 Appliances10/40GbE

QSFS™

REST

SSD

X86 Appliance, VM,or Software

On-Premises

Huge SSD tier for read andwrite optimization withalternate form factors

Linux OS

Deployment options

Non-Proprietary OS

Qumulo ScalableFile System

RESTful API

Remote Management & Monitoring

HDD

HDD for true hybrid andmaximum density

SMB

Page 11: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Flash-First Hybrid Design

10 / 40 GbE

NFS / SMB / REST

Standard Ethernet Layer

Client / Application Layer

Qumulo Core Data-Aware Scale-Out NAS Layer

Geo Processing

Genetic Analysis

Transcoding

Linear Editing

SSD HDD

Page 12: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Scale Out - Rebalancing

10 / 40 GbE

NFS / SMB / REST

Standard Ethernet Layer

Client / Application Layer

Qumulo Core Data-Aware Scale-Out NAS Layer

Geo Processing

Genetic Analysis

Transcoding

Linear Editing

SSD HDD

Page 13: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Traditional Scan-Based Management

Analytics Database

/

hometmp

neal

proj2

pete

proj3proj1proj2 proj3proj1

/tmp 10MB

Directory Total Size

/home/neal/proj1 11GB

/home/neal/proj2 20GB

/home/neal/proj3 1GB

/home/neal 30GB

/home/pete/proj1 22GB

/home/pete/proj2 101GB

/home/pete/proj3 1.4TB

/home/pete 1.53TB

/home/ 1.56TB

/ 1.56TB

Page 14: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Data Management at ScaleQumulo Cluster

Analytics Database

/tmp 10MB

Directory Total Size

/home/neal/proj1 11GB

/home/neal/proj2 20GB

/home/neal/proj3 1GB

/home/neal 30GB

/home/pete/proj1 22GB

/home/pete/proj2 101GB

/home/pete/proj3 1.4TB

/home/pete 1.53TB

/home/ 1.56TB

/ 1.56TB

/

hometmp

neal

proj2

pete

proj3proj1proj2 proj3proj1

Page 15: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Qumulo Real-Time AnalyticsQumulo Cluster

/

hometmp

neal

proj2

pete

proj3proj1proj2 proj3proj1

10MB

11GB 20GB 1GB

30GB

22GB 101GB 1.4TB

1.53TB

1.56TB

1.56TB

215GB 1.7TB

1.91TB

1.94TB

1.94TB

Real-Time Analytics Built into QSFS Instant metadata

updates Visual &

programmable

Benefits Real time insight No more tree walks Eliminate labor time

waste

Page 16: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Qumulo Real-Time AnalyticsQumulo Cluster

/

hometmp

neal

proj2

pete

proj3proj1proj2 proj3proj1

1 op 1,000 ops 10,000 ops

11,000 ops

11,000 ops

11,001 ops

1 op 1,000 ops 1,000,000 ops

1,001,000 ops

1,001,000 ops

1,001,001 ops

More than just capacity IOPS, access times,

hotness Fair sample tree by any

metric

Benefits IOPS use by file type

and user Data utilization &

storage utilization

Page 17: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Real-Time Analytics - 10 Billion Files• Groot - 10.4 billion 1K files in ~1.2 million directories

• Real-time capacity, performance, and usage analytics

• Usable capacity is accurate. Accounts for overhead

• 5th node joined cluster in 90 seconds to expand

• 17 hours to rebuild a failed 6TB hard drive (load)

Page 18: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Qumulo Q-Series Hybrid Storage Appliances

QC24 QC208

Page 19: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Qumulo QC24 Hybrid Storage ApplianceEntry Cost-Optimized 1U Node QC24 (former Q0626) Data-Aware Scale-Out NAS:

Qumulo Core software 1U form factor (4 nodes minimum)

Scales from 4 - 1,000+ nodes

Specifications NFS(v3), SMB(v2.1), REST 2x10GbE/node 24TB/node raw capacity (10.5TB Usable)

2 x 800GB SSD 4 x 6TB HDD

QC24

Page 20: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Qumulo QC208 Hybrid Storage ApplianceCapacity-Optimized 4U Node QC208 Data-Aware Scale-Out NAS:

Qumulo Core software 4U form factor (4 nodes minimum)

Scales from 4 - 1,000+ nodes Specifications

NFSv3, SMBv2.1, REST 4x40GbE/node 208TB/node raw capacity (102 TB Usable

13 x 480GB SSD 26 x 8TB HDD

QC208

Page 21: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

HPC Life Sciences: Large Hadoop Map ReduceQumulo Real World Examples Compute:

Hadoop/Spark Cluster - 640 cores HPC Forecasting Cluster - 16000 cores

Storage: 11 node QC24 used for HPC scratch space

Peak throughput just under 1GBps and Peak IOPs 140K, Sustained at 120K, average 100K (60 W/40 R)

6 node QC208 in a HPC farm Peak throughput just under 2GBps and Peak IOPs 80K

Page 22: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Qumulo Care

Page 23: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Customers

3 of Top 5 Film Animation Studios

SupermajorOil & Gas Company

IHME

Page 24: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Why Customers Choose Qumulo ? Data-Aware Scale Out NAS Software – QSFS runs on top of Linux

Flash-First Hybrid Design - For maximum performance & capacity

No Compromise Storage - Optimized for widest range of workloads & file

sizes Data Is What Matters - Real-time analytics built into the file system Cost Containment - Scale-out on commodity hardware Qumulo Care Customer Success – MissionQ Cloud, Dedicated Support,

Qston Rapid Customer-Driven Innovation – Agile Development 2-week release

cycles

100% Programmable - Interactive REST-API browser built- in, Qumulo

Community, github

Page 25: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

Qumulo Confidential

Page 26: Qumulo Confidential Bob Collins Qumulo Regional Sales Manager bob@qumulo.combob@qumulo.com, Twitter: 350Zbob, 972.489.8577 Paul Levine Senior Systems Engineer

NameTitleGroup

Questions?