coraid and university of utah - apple...

34
Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi, AVP Sales, Coraid Bob Fenner, Account Rep, Coraid Tyler Briggs, Systems Engineer, Coraid

Upload: dothu

Post on 07-Feb-2018

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

Coraid & University of Utah Mac OS X Users Group

May 17, 2012

Ed Sorgi, AVP Sales, Coraid Bob Fenner, Account Rep, Coraid Tyler Briggs, Systems Engineer, Coraid

Page 2: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

2

• People / Technology / Data Storage Trends

• Coraid Products / Customers Use cases

• Next steps

Agenda

Page 3: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

3

“Over the past 10 years, IT infrastructure improved exponentially in

server performance / virtualization , storage has been virtually stagnant,

growing only in capacity but not in performance”

http://www.nimbusdata.com/products/index.html

Page 4: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

4

Page 5: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

5

Apple Computers 1976

Page 6: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

6

Page 7: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

7

Page 8: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

8

Background Development Timeline

Page 9: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

9

Page 10: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

10

Coraid 2.0 “Escape Velocity”

Page 11: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

11

• Fix the network topology

• Create compute and network storage alignment

• Do to the storage cartel what CPQ/Dell did to DEC/SMCC

• Team originally comprised of Cisco Sr. Engineers

• Coraid Technology was incubated in the Linux market

• Ertherdrive first shipped in 2004….13 engineers

• Enters 2010 w/o sales team with 1,100 customers.

• Coraid raises $85m VC funds in 22 months : 10M in 1/10 , 25M 11/10 , 50M 10-2011

– Allegis / Azure / Menlo / Crosslink / Seagate / Kinetic /

Silverlake…..

• In Q3 2011 @ 1,500 customers incl. (Ford, Disney, US DoD, SONY Music , Home Depot etc..)

• 500% Revenue growth in 2010, 2011, 2012 target!

From Legacy to Modern : A $25 billion industry

09Q4 10Q1 10Q2 10Q3 10Q4

Bookings

Page 12: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

12

Storage 1.0 Storage 2.0 Storage 3.0

Companies

Business Driver Need for shared storage Performance Availability

Commoditization of Servers Virtualization

Commoditization of Storage Cloud Flexibility

Architecture Mainframe servers to central controllers to mainframe storage

x86 servers to central controllers to mainframe storage

x86 Servers to x86 Storage

Requirements High-Performance High-Availability

Varying Performance Varying Availability Simplified management

On demand, easy to scale, low cost Storage pools not silos Varying-Performance Capabilities

Key Innovations Fibre Channel, dual controllers, replication, mirroring

iSCSI, auto-tiering, caching, management capabilities

Ethernet connectivity Controllerless architectures Distributed processing Commodity hardware

Evolution of SAN: From “Legacy to Modern”

Page 13: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

13

Coraid = Ethernet-SAN

Connectivity Ethernet-SAN, not IP-SAN (iSCSI) or FC-SAN

Hardware x86-based, enterprise-level commodity shelves

Controller Per-shelf, not centralized

Maximum Capacity Per shelf: 108TBs, Per system: 65,000 shelves

Operating System CorOS distributed operating system

Shelf sizes 8, 16, 24, and 36-disk shelves

Supported Drives SATA, SAS, and SSD can be configured in the same chassis at the same time

Supported RAID levels 0, 1, 5, 6, 10, and JBOD (RAID-Z) in the same chassis

Availability Features Synchronous mirroring, snapshots, cloning, asynchronous replication

Page 14: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

14

Storage Processor

A

Storage Processor

B

Fabric A Fabric B

DAE 1

DAE 2

DAE 3

DAE 4

Back End Bus

Controller

Front End Bus

Disk

Bottlenecks & Complexity = unplanned spending & downtime.

Legacy Storage (FC & iSCSI) Coraid Cloud Storage

Performance Calculation:

•Disk IOPS, back end bus max speed of 4gbs, controller max IOPS, front

end/backend bus limitation

•Backend FC port limitation of 360mb/s throughput per port CX-4 Clarion

Performance calculation:

•Disk IOPs = Performance

•SRX NIC provides 1200mb/s throughput per port/NIC

Coraid SRX

Coraid SRX

Ethernet Switch 1

Ethernet Switch 2

Legacy vertical dual processor design vs. Redundant Nodes design = Fewer Bottlenecks , far easier to scale and diagnose a problem…

Page 15: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

15

Cloud Economics

Future of storage: Commodity Economics. Enterprise Capabilities. Ethernet Simplicity.

Page 16: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

16

• People / Technology / Data Storage Trends

• Coraid Products / Customers Use cases

• Next steps

Agenda

Page 17: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

17

Simple, Performance , Scalable Modular Packaging

SRX-Series HBAs VSX3500 ESM1500 SP3000

• Price-Performance • 10 GbE & 1 GbE • SSD, SAS, SATA

• 16 Drv – SRX2800 • 24 Drv – SRX3200 • 24 Drv – SRX3500 • 36 Drv – SRX4200

• End-to-End Solution • 10 GbE & 1 GbE • PCIe HBA • Blade Mezzanine

• Virtualization appliance

• Large Vol Mgt • Local Synch Mirror • LUN Cloning • Asynch Replication

• Visualization • Email Alerting • Reporting • Centralized

Management • H/P NAS Server

Coraid CorOS™ Version 6.0

Distributed Operating System RAIDShield Operating System Drivers SAN Virtualization Centralized Management

Page 18: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

18

Technology Network HBA $/TB

AoE 1Gb Ethernet (x2) $199 $500

AoE 10Gb Ethernet (x2) $799 $700

iSCSI 1Gb TCP/IP $1,000 $1-3K

FC 2-4Gb Fibre Ch $1-2K $3-8K

Technology Cap Ex Op Ex Perf

AoE Low Low Best

iSCSI Med Med-High Low

FC High High Good

Price-Performance / COST Comparisons

Page 19: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

19

Comparative “ Legacy vs Modern” Cost Models Evolving to Cloud

• High cost to buy in • Paying for unused features

• Uneven costs for expansion • Pay a premium for performance

• Scale-out, virtualized • Buy the capabilities you need • Incremental scalability delivers a predictable cost curve • Tune performance as required

15%

25% 40%

60%

COST

CAPACITY

COST

CAPACITY

Mainframe / Storage 1.0 & 2.0 Cloud / Storage 3.0

Page 20: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

20

Coraid – Filesystem Agnostic

NFS VMFS ZFS NTFS GPFS

Coraid EtherDrive

Coraid works well with: • Virtualization • File sharing • Clustering • Single-namespace • OS operations • High performance computing • Etc.

OS X

Page 21: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

21

EtherDrive Ethernet SAN : • “Bare metal performance” • Eliminates complex topologies • No more complex multipathing • No controller bottleneck • Ethernet simplicity • Lightweight protocol wins!

Scale-out Ethernet SAN

Ethernet

AoE

Ethernet

IP

TCP

iSCSI

SCSI

Fibre Chan

Fibre Chan

SCSI

ATA

AoE iSCSI Fibre Channel

Storage Protocol Stacks

Page 22: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

22

• Layer 2 Protocol

– Non-routable

– SAN Fabric can span multiple Layer 2 Switches

– Requires no IP Addressing Scheme

• Not Connection-Based

– Physical Connection to SAN Fabric is only requirement

– Simplified Storage Configuration

• Transmission Controls Built-In

• iSCSI utilizes Layer 4 TCP for Transmission Control

• Fibre Channel uses proprietary $$ hardware

• AoE = Standards based , Simple , Efficient , Performance!

– 12 Page Specification

• http://support.coraid.com/documents/AoEr11.txt

ATA over Ethernet - AoE Protocol

Page 23: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

23

Traditional Storage Data Path

iSCSI (FC, FCoE): Connection-based, serial delivery

iSCSI 64K IO Transfer CRC Segment Segment Segment Segment Segment Segment Segment Segment Segment

64K IO Transfer

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #1

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #2

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #3

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #4

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #5

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #6

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #7

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #8

Initiator (IO is bound to iSCSI connections)

Port 0

Port 1

Port 2

Port 3

Port 0

Port 1

Port 2

Port 3

Array

Path0

Path1

Path2

Path3

Verify CRC, Remove Ethernet Layer

Remove IP Header

TCP: Re-assemble Byte Segments

iSCSI: Verify IO Integrity

64K IO: Send to disk

TCP Data (IO Segment) CS

IP Data

Ethernet Data (Jumbo) CRC

Frame #9

Frame #1

Frame #2

Frame #3

Frame #4

Frame #5

Frame #6

Frame #7

Frame #8

Frame #9

iSCSI Verify

IO

Disk

ACK

ACK ACK

ACK

Page 24: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

24

Port 0

Port 1

Port 2

Port 3

Cloud Storage Data Path

AoE: Connectionless, parallel delivery

AoE Initiator Array

Disk

AoE Mapping

64K IO Transfer 1 2 3 4 5 6 7 8

Ethernet AoE Data Segment CRC

Port 0

Port 1

Port 2

Port 3

Path0

Path1

Path2

Path3

Write 1A

Write 1B

Write 1C

Write 1D

Write 2A

Write 2B

Write 2C

Write 2D

AoE 8K block (data)

ACK

ACK

ACK

ACK

Page 25: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

25

ESG Lab Validation Delivering on the Promise

“ESG Lab has tested nearly every major storage system in the industry, and we found the ease of implementation and management of Coraid EtherDrive storage shockingly simple compared to most Fibre Channel and iSCSI systems. The simplicity of the system is brilliant, and the price-performance is staggering. It's fair to say we were enormously impressed.”

– Tony Palmer, Senior Engineer at ESG Lab

25

Higher performance than Fibre Channel at

20% the cost

Performance: 1800+ MB/sec per shelf

ESG was able to provision EtherDrive in

less than 2 minutes from power on

Page 26: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

26

ESG Review/”validation” of Ethernet SAN

Page 27: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

Customer Case Studies

Page 28: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

28

Case Study: Cameron Pace Group / Coraid

• Cameron Pace Studios was looking for high performing, scalable block storage

• Mac OS X integration with Coraid

• Apple Xserve platform - direct connect

• 800mb/s throughput

• SRX unit with 2TB drives

• Video Editing, Final Cut Pro, etc.

Page 29: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

29

National Human Genome Research Institute Industry: Healthcare Use Case: HPC, Database, Backup

Customer Need

• A high performance Linux cluster for human genome sequencing with fast 10 GbE SAN storage.

• A scalable primary storage system for Linux application servers.

• A scalable storage system for use as disk to disk backup.

Benefits

• Fast performance for HPC Storage

• Reliability for Primary Storage

• Scalability and Economy for Disk to Disk Backup

Solution

“We have found the Coraid EtherDrive system to be a good balance between economy and performance…it gives us a tremendous amount of flexibility” - Dr. Elliott Margulies

Page 30: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

30

Sony Music Australia

We considered other storage systems but only the Coraid solution met our price, performance and density requirements.” - Dustin McClung, VP, IS&T Sony Asia Pacific

Industry: Media & Entertainment Use Case: File Sharing

Customer Need

• Storage that could grow

• Cost

• Ease of use

Benefits

• Coraid offered Sony Music Australia the scalability and performance that they were looking for at the right price point.

Solution

NAS Filer

5 EtherDrive Storage Arrays

1 GbE Ethernet SAN

240 TB

Page 31: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

31

Benefits

• Out-performed FC and iSCSI alternatives for a fraction of the cost.

• Grow capacity in line with virtual machine growth.

• Deploy & configure new storage in minutes.

Atlantic Media Company

SRX3500 SRX3500

LAN

Web Clients

Ethernet SAN

Industry: Media and Entertainment Use Case: VMware virtualization

Customer Need

• VMware Server virtualization project

• Server failover for increased uptime

• Easy to deploy and grow 11TB shared storage

Solution

“It was vital to maintain uptime, rather than risking loss of revenue and disputes with advertisers.” The Coraid storage was one of the easiest deployments I have done in my life”. - Dave Mouyal, Network Administrator

Page 32: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

32

Validation of Etherdrive “ Value Innovation “

“We considered other storage systems but only the Coraid

solution met our price, performance and density requirements.” - Dustin McClung, VP, IS&T , Sony

“The nice thing about Coraid EtherDrive storage running over

Ethernet is that it was easy to install. Its enterprise-class storage

with no single point of failure, yet Coraid designed it with ease of

use in mind.” - Rex Klein, CEO, Barryhund Administrators Inc.

“Our previous Fibre Channel solution was very expensive in

terms of OPEX. The Coraid Ethernet SAN solution is more

efficient, more practical, and easier to use.” - Nicolas Menoux, CTO, NotreFamille.com

“Our Coraid systems have curbed our needs for additional IT

staff; What took a working week before only takes a day now” - Dan Byne, Network and Systems Engineer, Palmers College

“First SRX2800 and ESM in the rack and creating first test

LUN, so far, easier than what I saw at VMworld last fall!”

- Erik Kringlie, Director of Data Centers, Valley City State University

Page 33: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

33

• People / Technology / Data Storage Trends

• Coraid Products / Customers Use cases

• Next steps….Thank you!

Agenda

Page 34: Coraid and University of Utah - Apple Inc.deimos3.apple.com/WebObjects/Core.woa/FeedEnclosure/utah.edu... · Coraid & University of Utah Mac OS X Users Group May 17, 2012 Ed Sorgi,

34

40% IT Budget

Ethernet always wins..100Gbs vs. FC 8-10GB

Legacy SAN is a poor fit with Cloud and Virtualization

Storage is strategic / Left Hand, DD, 3Par, others

Unsustainable storage costs in uncertain economy

Storage Industry “Dynamics”…Etherdrive / Coraid is doing so well!